-- Logs begin at Tue 2022-07-26 12:03:51 UTC, end at Tue 2022-07-26 13:07:56 UTC. -- Jul 26 12:42:28.234716 dv-cinder-850939-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 12:42:28.243608 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 12:42:28.245836 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 12:42:28 2022] *** Jul 26 12:42:28.245836 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 12:42:28.245836 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 12:42:28.245836 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: nodename: dv-cinder-850939-2-iscsi Jul 26 12:42:28.245836 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: machine: x86_64 Jul 26 12:42:28.245836 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: clock source: unix Jul 26 12:42:28.245836 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: pcre jit disabled Jul 26 12:42:28.245836 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: detected number of CPU cores: 4 Jul 26 12:42:28.245836 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: current working directory: / Jul 26 12:42:28.245836 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: detected binary path: /usr/bin/uwsgi-core Jul 26 12:42:28.246510 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: your processes number limit is 47680 Jul 26 12:42:28.246510 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: your memory page size is 4096 bytes Jul 26 12:42:28.246510 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: detected max file descriptor number: 2048 Jul 26 12:42:28.246510 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: lock engine: pthread robust mutexes Jul 26 12:42:28.246510 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: thunder lock: enabled Jul 26 12:42:28.246510 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 12:42:28.246510 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 12:42:28.285519 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: Python main interpreter initialized at 0x563e000879c0 Jul 26 12:42:28.285519 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: python threads support enabled Jul 26 12:42:28.285519 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: your server socket listen backlog is limited to 100 connections Jul 26 12:42:28.285519 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: your mercy for graceful operations on workers is 90 seconds Jul 26 12:42:28.285852 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 12:42:28.285926 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: *** Operational MODE: preforking *** Jul 26 12:42:28.286181 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: *** uWSGI is running in multiple interpreter mode *** Jul 26 12:42:28.286181 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: spawned uWSGI master process (pid: 114788) Jul 26 12:42:28.288972 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: spawned uWSGI worker 1 (pid: 114789, cores: 1) Jul 26 12:42:28.288972 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: spawned uWSGI worker 2 (pid: 114790, cores: 1) Jul 26 12:42:28.288972 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 12:42:28.286370 dv-cinder-850939-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 12:42:28.945629 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 12:42:28.946289 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 12:42:30.037596 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 12:42:30.037596 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: from cryptography.utils import int_from_bytes Jul 26 12:42:30.038227 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 12:42:30.038227 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: from cryptography.utils import int_from_bytes Jul 26 12:42:30.039186 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 12:42:30.039186 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: from cryptography.utils import int_from_bytes Jul 26 12:42:30.039613 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 12:42:30.039613 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: from cryptography.utils import int_from_bytes Jul 26 12:42:32.551013 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 12:42:32.551612 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 12:42:32.551735 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 12:42:32.551735 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 12:42:32.552161 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 12:42:32.552244 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 12:42:32.552330 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 12:42:32.552411 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 12:42:32.552496 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 12:42:32.552709 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 12:42:32.552846 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.553098 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.553222 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.553423 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.553516 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.553742 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.553842 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.554062 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.554165 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.554370 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.554459 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.554685 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.554788 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.555005 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.555097 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.555320 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.555403 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.555585 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.555711 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.555931 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.556016 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.556244 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.556334 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850939-2-iscsi {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.556568 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850939-2-iscsi {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.556653 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.556874 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.556963 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.557183 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.557279 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.557494 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.557585 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.557796 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.557884 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.558101 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.558183 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.558411 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.558501 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.558714 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.558904 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.559218 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.559366 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.559530 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.559679 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.559860 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.559970 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.560190 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.560373 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.560549 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.560631 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.560810 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.560895 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.561122 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.561219 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.561449 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.561553 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.561758 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.561856 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.562082 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.562177 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.562393 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.562561 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850939-2-iscsi {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.562785 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.562976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850939-2-iscsi {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.563097 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.563180 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.563409 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.563494 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.563749 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.563852 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.564148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.564240 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.564459 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.564544 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.564769 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.564875 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.565087 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.565183 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.565392 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.565519 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.566291 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.566388 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.566601 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.566707 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.566923 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.567018 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.567243 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.567339 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.567545 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.567649 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.567881 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.567964 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.568190 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.568281 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.568500 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.568586 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.568803 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.568885 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.569109 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.569194 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.569362 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.569462 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.569650 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.569733 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.569958 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.570043 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.570280 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.570363 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.570601 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.570687 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.570856 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.570948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.571107 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.571193 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.571401 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.571493 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.571746 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.571834 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.572059 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.572141 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.572364 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.572448 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.572670 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.572760 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.573062 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.573280 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.573371 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.573583 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.573666 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.573888 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.573977 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.574192 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.574276 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.574498 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.574582 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.574810 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.574893 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.575125 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.575216 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.575430 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.575512 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.575763 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.575861 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.576087 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.576171 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.576425 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.576528 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.576706 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.576804 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.577016 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.577099 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.577354 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.577435 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.577664 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.577760 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.577971 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.578061 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.578289 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.578373 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.578596 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.578690 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.578903 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.578987 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.579207 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.579289 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.579511 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.579601 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.579854 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.579950 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.580156 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.580240 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.580411 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.580502 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.580714 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.580804 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.581013 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.581103 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.581366 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.581475 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.581754 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.581849 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.581967 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.582052 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.582271 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.582356 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.582574 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.582670 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.582872 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.583012 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.583175 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.583261 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.583479 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.583570 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.583812 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.583903 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.584118 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.584192 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.584423 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.584504 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.584730 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.584812 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.585034 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.585108 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.585338 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.585410 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.585639 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.585722 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.585962 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.586045 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.586266 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.586340 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.586574 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.586658 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.586939 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.587087 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.587302 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.587443 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.587593 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.587921 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.587921 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.588172 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.588319 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.588462 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.588462 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.588766 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.588766 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.588892 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.589137 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.589240 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.589318 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.589403 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.589600 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.589686 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.589930 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.590018 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.590224 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.590301 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.590527 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.590609 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.590835 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.590910 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.591142 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.591217 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.591448 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.591530 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.591779 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.591858 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.592084 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.592159 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.592386 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.592466 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.592687 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.592760 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.592993 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.593068 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.593297 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.593588 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.593739 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.593989 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.594137 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.594267 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.594509 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.594704 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.594821 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.595130 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.595267 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.595438 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.595879 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.596029 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.596159 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.596297 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.596432 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.596564 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.596717 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.596861 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.597074 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.597216 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.597404 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:42:32.597538 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.597747 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.597876 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.598075 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.598209 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.598367 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.598691 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.598821 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.598956 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.599091 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.599224 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.599361 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.599589 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.599738 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.599928 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.600249 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.600376 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.600569 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.600904 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.601033 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.601220 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.601501 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.601630 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.601842 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.602108 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.602261 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.602627 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.602773 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.602918 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.603053 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.603186 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.603324 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.603454 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.603594 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.603748 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.603825 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.604096 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.604231 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.604410 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.604545 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.604880 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.605018 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.605146 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.605275 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.605420 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.605549 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.605677 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.605803 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.605936 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.606064 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.606239 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.606369 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.606572 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.606712 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.606884 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.607023 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.607203 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.607334 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.607515 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.607678 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.608035 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.608175 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.608306 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.608442 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.608570 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.608697 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.608838 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.608985 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.609125 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.609253 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.609381 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.609507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.609665 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.609803 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.610137 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.610282 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.610378 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.610447 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.610598 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.610682 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.610926 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.611061 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.611214 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.611342 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.611520 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.611764 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.611895 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.612024 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.612150 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.612282 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.612970 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.613123 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.613274 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.613409 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.613596 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.613745 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.613927 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.614073 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.614234 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.614363 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.614572 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.614713 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.614882 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.615007 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.615191 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.615321 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.615499 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.615701 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.615850 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.615991 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.616124 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.616255 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.616420 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.616557 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.616730 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.616863 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.617036 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.617174 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.617352 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.617493 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.617661 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.617788 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.617968 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.618102 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.618279 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.618419 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.618582 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.618714 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.618888 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.619016 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.619202 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.619349 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.619513 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.619701 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.619834 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.619960 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.620139 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.620542 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.620727 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.620856 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.621015 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.621152 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.621337 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.621507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.621637 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.621764 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.621949 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.622079 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.622255 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.622385 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.622571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.622700 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.622883 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.623021 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.623194 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.623355 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.623510 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.623669 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.623840 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.623999 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.624139 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.624269 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.624442 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.624570 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.624747 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.624889 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.625052 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.625182 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.625362 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.625492 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.625667 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.625804 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.625972 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.626102 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.626277 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.626415 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.626582 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.626719 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.626887 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.627022 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.627209 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.627399 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.627546 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.627715 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.627846 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.627973 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.628691 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.628838 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.628977 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.629106 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.629277 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.629404 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.629584 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.629716 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.629891 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.630022 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.630197 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.630326 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.630502 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.630632 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.630834 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.630971 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.631143 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.631272 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.631448 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.631590 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.631777 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.631907 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.632083 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.632211 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.632411 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.632555 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.632724 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.632851 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.633043 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.633170 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.633356 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.633494 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.633703 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.633862 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.633997 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.634150 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.634293 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.634437 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.634611 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.634739 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.634927 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.635067 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.635229 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.635364 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.635542 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.635781 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.635926 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.636056 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.636192 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.636321 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.636488 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.636617 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.636809 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.636937 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.637125 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.637263 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.637445 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.637573 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.637782 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.637920 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.638064 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.638198 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.638353 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.638482 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.638666 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.638797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.638989 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.639118 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.639301 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.639430 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.639673 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.639814 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.639960 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.640093 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.640253 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.640388 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.640565 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.640702 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.640876 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.641009 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.641178 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.641309 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.641489 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.641700 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.641845 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.641985 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.642122 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.642247 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.642386 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.642526 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.642704 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.642840 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.643015 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.643149 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.643330 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.643462 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.643683 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.643837 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.643994 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.644121 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.644302 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.644441 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.644611 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.644697 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.644923 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.645016 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.645239 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.645326 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.645551 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.645648 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.645863 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.645947 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.646170 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.646255 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.646481 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.646564 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.646790 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.646886 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.647098 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.647193 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.647401 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.647485 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.647735 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.647834 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.648046 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.648129 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.648356 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.648490 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.648665 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.648755 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.648978 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.649061 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.649280 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.649363 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.649587 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.649679 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.649892 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.649975 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.650200 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.650284 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.650503 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.650594 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.650807 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.650891 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.651110 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.651201 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.651426 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.651510 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.651777 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.651869 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.652083 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.652177 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.652388 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.652480 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.652696 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.652787 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.653003 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.653092 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.653316 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.653401 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.653621 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.653705 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.653925 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.654000 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.654229 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.654306 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.654546 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.654619 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.654856 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.654945 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.655163 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.655237 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.655469 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.655555 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.655806 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.655912 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.656115 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.656199 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.656429 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.656515 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.656735 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.656826 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.657042 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.657126 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.657350 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.657447 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.657656 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.657757 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.657961 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.658044 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.658271 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.658364 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.658582 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.658846 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.658930 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.659179 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.659263 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.659524 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.659629 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.659866 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.659952 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.660177 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.660262 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.660487 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.660579 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.660800 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.660884 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.661110 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.661193 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.661426 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.661520 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.661823 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.662000 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.662087 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.662336 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.662421 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.662638 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.662729 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.662949 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.663042 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.663255 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.663343 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.663568 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.663674 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.663903 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.663988 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.664214 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.664310 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.664519 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.664605 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.664822 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.664916 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.665138 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.665273 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.665443 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.665615 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.665738 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.665823 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.666042 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.666126 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.666347 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.666445 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.666649 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.666733 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.666952 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.667043 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.667263 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.667356 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.667563 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.667771 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.667891 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.667977 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.668192 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.668292 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.668494 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.668585 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.668810 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.668902 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.669116 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.669202 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.669426 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.669511 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.669730 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.669814 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.670055 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.670141 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.670365 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.670451 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.670675 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.670767 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.670978 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.671062 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.671283 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.671418 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.671580 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.671683 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.671953 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.672052 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.672227 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.672322 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.672531 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.672624 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.672840 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.672925 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.673149 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.673234 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.673464 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.673562 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.673774 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.673858 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.674077 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.674161 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.674387 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.674479 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.674687 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.674770 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.675535 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.675659 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.675857 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.675944 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.676160 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.676243 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.676466 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.676613 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.676773 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.676866 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.677079 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.677162 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.677381 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.677465 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.677681 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.677765 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.677979 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.678062 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.678282 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.678365 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.678586 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.678670 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.678890 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.678981 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.679193 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.679290 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.679495 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.679586 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.679830 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.679916 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.680137 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.680229 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.680438 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.680521 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.680753 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.680848 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.681053 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.681145 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.681356 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.681455 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.681663 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.681756 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.681962 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.682055 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.682264 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.682347 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.682571 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.682653 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.682878 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.682973 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.683181 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.683265 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.683487 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.683570 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.683824 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.683912 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.684127 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.684212 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.684430 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.684520 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.684733 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.684819 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.685033 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.685116 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.685332 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.685421 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.685643 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.685743 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.685934 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.686019 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.686238 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.686336 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.686539 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.686622 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.686863 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.686954 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.687154 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.687251 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.687459 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.687549 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.687798 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.687887 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.688110 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.688208 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.688413 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.688497 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.688716 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.688800 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.689020 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.689113 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.689325 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.689410 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.689629 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.689714 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.689955 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.690052 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.690265 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.690357 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.690625 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.691206 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.691425 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.691511 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.691752 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.691848 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.692078 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.692163 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.692389 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.692473 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.692700 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.692782 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.693007 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.693091 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.693314 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.693398 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.693638 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.693730 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.693948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.694042 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.694256 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.694341 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.694569 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.694652 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.694877 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.695034 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.695195 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.695279 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.695497 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.695579 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.695834 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.695937 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.696140 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.696225 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.696447 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.696538 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.696759 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.696852 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.697070 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.697160 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.697383 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.697574 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.697886 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.698010 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.698107 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.698193 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.698271 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.698347 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.698585 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.698672 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.698895 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.698978 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.699202 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.699286 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.699510 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.699594 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.699840 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.699935 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.700147 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.700230 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.700460 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.700546 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.700760 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.700844 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.701068 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.701161 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.701371 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.701457 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.701680 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.701764 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.701983 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.702075 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.702291 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.702421 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.702601 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.702736 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.702906 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.703050 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.703232 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.703359 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.703544 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.703703 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.703874 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.704010 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.704184 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.704347 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.704489 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.704639 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.704799 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.704946 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.705103 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.705361 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.705539 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.705672 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.705906 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.705996 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.706178 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.706315 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.706491 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.706599 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.706805 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.706892 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.707118 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.707203 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.707436 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.707519 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.707776 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.707881 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.708085 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.708171 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.708403 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.708488 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.708726 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.708811 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.709032 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.709117 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.709353 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.709451 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.709688 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.709781 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.709995 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.710080 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.710308 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.710401 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.710633 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.710754 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.710937 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.711067 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.711249 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.711379 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.711553 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.711740 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.711901 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.712067 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.712207 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.712391 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.712529 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.712696 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.712946 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.713030 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.713259 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.713345 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.713564 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.713648 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.713929 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.714018 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.714241 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.714347 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.714556 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.714642 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.714859 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.714951 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.715182 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.715268 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.715503 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.715587 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.715836 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.715943 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.716156 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.716294 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.716467 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.716566 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.716793 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.716881 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.717118 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.717205 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.717429 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.717517 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.717744 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.717830 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.718049 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.718148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.718370 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.718463 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.718681 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.718776 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.718986 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.719081 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.719291 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.719377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.719612 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.719732 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.719942 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.720047 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.720253 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.720340 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.720564 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.720658 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.720874 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.720969 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.721177 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.721262 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.721482 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.721577 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.722337 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.722444 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.722647 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.722733 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.722973 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.723057 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.723286 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.723371 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.723594 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.723711 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.723933 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.724019 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.724240 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.724326 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.724549 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.724634 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.724853 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.724939 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.725158 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.725253 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.725459 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.725544 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.725763 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.725859 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.726098 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.726195 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.726395 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.726490 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.726717 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.726814 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.727039 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.727126 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.727345 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.727431 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.727680 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.727783 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.727996 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.728081 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.728302 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.728388 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.728607 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.728702 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.728912 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.729012 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.729251 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.729336 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.729555 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.729641 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.729856 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.729941 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.730168 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.730263 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.730473 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.730560 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.730776 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.730861 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.731082 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.731175 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.731393 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.731487 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.731719 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.731808 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.732025 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.732123 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.732331 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.732418 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.732652 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.732738 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.732955 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.733053 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.733273 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.733366 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.733578 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.733663 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.733881 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.733976 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.734183 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.734276 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.734492 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.734577 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.734797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.734929 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.735100 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.735188 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.735404 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.735491 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.735751 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.735859 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.736059 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.736160 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.736389 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.736503 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.736691 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.736786 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.736995 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.737079 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.737305 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.737412 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.738189 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.738295 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.738513 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.738604 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.738825 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.738909 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.739140 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.739225 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.739458 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.739543 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.739799 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.739888 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.740113 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.740199 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.740424 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.740571 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.740738 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.740836 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.741054 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.741139 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.741371 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.741587 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.741679 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.741915 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.742002 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.742230 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.742323 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.742546 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.742638 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.742860 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.742948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.743177 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.743262 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.743490 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.743584 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.743830 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.743919 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.744144 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.744228 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.744462 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.744670 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.744778 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.745001 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.745093 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.745584 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.745677 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.745903 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.745989 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.746227 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.746492 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.746581 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.746660 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.746837 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.746932 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.747151 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.747244 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.747464 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.747563 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.747801 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.747889 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.748118 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.748217 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.748467 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.748626 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.748777 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.748869 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.749095 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.749181 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.749411 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.749498 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.749724 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.749815 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.750035 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.750120 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.750350 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.750443 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.750658 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.750743 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.750971 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.751065 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.751284 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.751370 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.751597 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.751713 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.751937 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.752043 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.752254 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.752341 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.752571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.752657 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.752885 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.752979 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.753224 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.753317 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.753538 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.753623 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.753889 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.753986 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.754783 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.754912 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.754992 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.755167 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.755246 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.755365 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.755456 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.755535 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.755683 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.755787 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.756004 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.756097 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.756323 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.756598 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.756691 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.756779 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.756950 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.757035 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.757256 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.757499 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.757599 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.757816 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.757903 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.758152 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.758246 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.758474 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.758571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.758792 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.758899 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.759093 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.759186 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.759410 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.759513 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.759737 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.759836 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.760079 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.760280 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.760387 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.760634 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.760721 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.760956 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.761041 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.761286 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.761379 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.761608 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.761781 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.761923 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.762016 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.762225 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.762318 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.762544 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.762630 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.762850 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.762940 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.763157 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.763386 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.763478 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.763768 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.763859 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.764088 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.764182 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.764391 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.764476 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.764707 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.764793 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.765019 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.765117 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.765323 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.765409 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.765634 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.765721 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.765938 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.766035 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.766243 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.766327 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.766609 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.766767 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.766849 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.766936 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.767147 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.767240 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.767449 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.767534 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.767775 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.767879 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.768086 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.768174 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.768388 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.768480 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.768715 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.768804 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.769018 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.769103 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.769323 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.769416 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.769634 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.769720 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.769937 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.770021 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.770243 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.770328 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.770543 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.770625 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.770846 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.770920 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.771153 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.771248 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.771457 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.771552 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.771791 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.771883 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.772105 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.772201 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.772412 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.772496 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.772717 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.772800 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.773018 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.773114 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.773326 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.773411 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.773629 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.773714 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.773938 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.774033 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.774274 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.774359 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.774601 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.774815 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.774900 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.775149 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.775235 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.775471 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.775556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.775823 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.775921 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.776149 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.776235 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.776467 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.776559 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.776769 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.776878 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.777061 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.777148 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.777382 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.777476 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.777692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.777921 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.778015 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.778259 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.778354 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.778580 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.778665 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.778885 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.778977 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.779193 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.779286 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.779502 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.779701 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.779838 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.779924 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.780146 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.780229 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.780453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.780549 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.780801 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.780899 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.781067 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.781159 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.781374 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.781467 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.781686 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.781833 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.781995 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.782082 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.782305 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.782392 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.782614 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.782707 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.782923 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.783008 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.783232 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.783319 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.783541 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.783627 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.783875 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.783974 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.784184 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.784790 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.785024 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.785127 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.785338 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.785430 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.785671 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.785758 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.785985 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.786069 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.786293 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.786385 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.786609 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.786718 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.786957 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.787057 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.787236 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.787332 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.787549 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.787672 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.787888 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.787973 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.788202 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.788296 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.788520 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.788605 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.788854 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.788954 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.789176 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.789297 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.789483 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.789583 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.789811 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.789898 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.790155 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.790243 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.790486 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.790572 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.790814 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.790919 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.791123 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.791220 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.791430 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.791525 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.791762 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.791872 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.792074 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.792162 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.792394 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.792489 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.792705 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.792800 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.793007 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.793101 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.793311 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.793406 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.793620 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.793716 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.793925 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.794020 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.794229 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.794316 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.794533 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.794629 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.794836 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.794924 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.795150 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.795236 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.795455 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.795543 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.795788 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.795897 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.796094 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.796182 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.796397 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.796486 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.796700 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.796787 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.797006 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.797107 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.797311 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.797400 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.797616 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.797704 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.797918 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.798012 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.798219 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.798318 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.798522 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.798621 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.798822 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.798916 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.799124 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.799210 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.799429 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.799526 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.799754 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.799861 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.800118 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.800219 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.800454 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.800542 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.800762 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.800851 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.801116 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.801210 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.801373 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.801461 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.801680 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.801768 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.801982 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.802070 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.802305 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.802391 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.802643 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.802731 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.802956 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.803043 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.803269 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.803364 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.803579 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.803691 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.803916 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.804002 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.804227 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.804322 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.804536 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.804620 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.804857 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.804942 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.805172 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.805269 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.805480 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.805561 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.805809 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.805905 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.806117 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.806212 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.806428 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.806515 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.806738 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.806825 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.807071 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.807178 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.807351 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.807437 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.807679 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.807772 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.807993 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.808090 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.808304 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.808391 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.808619 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.808717 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.808926 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.809015 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.809245 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.809331 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.809559 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.809656 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.809869 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.809957 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.810175 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.810260 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.810493 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.810603 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.810817 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.810913 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.811144 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.811263 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.811455 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.811747 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.811835 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.811901 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.812156 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.812253 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.812521 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.812627 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.812875 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.812984 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.813200 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.813287 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.813529 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.813684 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.813883 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.813973 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.814193 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.814287 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.814524 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.814613 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.814768 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114790) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 12:42:32.814854 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.815151 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.815481 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.816376 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.816692 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.817044 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.817380 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.817694 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.818009 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.818316 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:42:32.818562 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 12:42:32.968257 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO dbcounter [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] Registered counter for database nova_api Jul 26 12:42:32.973016 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO dbcounter [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] Registered counter for database nova_api Jul 26 12:42:32.989908 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_db.sqlalchemy.engines [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:42:32.994163 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG oslo_db.sqlalchemy.engines [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:42:32.997451 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writer thread running {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:42:33.001001 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG dbcounter [-] [114789] Writer thread running {{(pid=114789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:42:33.053959 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.context [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75e7599b-cac8-41c9-b1ee-f59349f865d3(cell1) {{(pid=114790) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 12:42:33.057326 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.context [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75e7599b-cac8-41c9-b1ee-f59349f865d3(cell1) {{(pid=114789) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 12:42:33.057882 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:42:33.059468 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:42:33.060280 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:42:33.061310 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG oslo_concurrency.lockutils [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:42:33.062259 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:42:33.062880 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG oslo_concurrency.lockutils [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:42:33.063705 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG oslo_concurrency.lockutils [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:42:33.064245 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO dbcounter [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] Registered counter for database nova_cell0 Jul 26 12:42:33.066222 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG oslo_concurrency.lockutils [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114789) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:42:33.068224 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO dbcounter [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] Registered counter for database nova_cell0 Jul 26 12:42:33.070135 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO dbcounter [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] Registered counter for database nova_cell1 Jul 26 12:42:33.073574 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO dbcounter [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] Registered counter for database nova_cell1 Jul 26 12:42:33.083141 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_db.sqlalchemy.engines [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:42:33.083141 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_db.sqlalchemy.engines [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:42:33.083408 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG oslo_db.sqlalchemy.engines [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:42:33.086445 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG dbcounter [-] [114789] Writer thread running {{(pid=114789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:42:33.087101 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writer thread running {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:42:33.087197 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG oslo_db.sqlalchemy.engines [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:42:33.088600 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writer thread running {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:42:33.229875 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG dbcounter [-] [114789] Writer thread running {{(pid=114789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:42:33.238589 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO dbcounter [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] Registered counter for database nova_cell0 Jul 26 12:42:33.240475 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO dbcounter [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] Registered counter for database nova_cell0 Jul 26 12:42:33.245895 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG oslo_db.sqlalchemy.engines [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:42:33.247548 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_db.sqlalchemy.engines [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114790) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:42:33.251002 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG dbcounter [-] [114789] Writer thread running {{(pid=114789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:42:33.252139 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writer thread running {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:42:33.587589 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: WARNING keystonemiddleware.auth_token [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 12:42:33.590132 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: WARNING keystonemiddleware.auth_token [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 12:42:33.594840 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: WARNING keystonemiddleware.auth_token [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 12:42:33.597886 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: WARNING keystonemiddleware.auth_token [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 12:42:33.933350 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: WARNING keystonemiddleware.auth_token [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 12:42:33.935315 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: WARNING keystonemiddleware.auth_token [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 12:42:33.939378 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: WARNING keystonemiddleware.auth_token [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 12:42:33.941903 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: WARNING keystonemiddleware.auth_token [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 12:42:33.946015 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563e000879c0 pid: 114789 (default app) Jul 26 12:42:33.947155 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563e000879c0 pid: 114790 (default app) Jul 26 12:42:33.948137 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:42:33.949307 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-a52765f2-d488-442a-9d8f-cc05f86669fe None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001765 Jul 26 12:42:33.949713 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Tue Jul 26 12:42:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:43:49.865290 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:43:49.866512 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Jul 26 12:43:49.867068 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:43:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:43:49.879263 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG dbcounter [-] [114789] Writing DB stats nova_api:SELECT=3 {{(pid=114789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:49.880215 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG dbcounter [-] [114789] Writing DB stats nova_cell0:SELECT=3 {{(pid=114789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:49.881876 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG dbcounter [-] [114789] Writing DB stats nova_cell1:SELECT=3 {{(pid=114789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:49.882674 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG dbcounter [-] [114789] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:50.755051 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-891b9ac7-4f89-4d4d-a71a-1dd96498a2af admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:43:50.787228 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-891b9ac7-4f89-4d4d-a71a-1dd96498a2af admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.913858 Jul 26 12:43:50.788295 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 26 12:43:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:43:53.030386 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:43:53.031394 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-d7c72755-162f-47eb-961a-6990e7ecf693 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 26 12:43:53.037746 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 2/4] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:43:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:43:53.538933 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-dd0cc2a6-0377-4c4b-93c5-67dc8b2fd637 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1}} {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:43:53.559270 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:43:53.559270 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: warnings.warn(msg) Jul 26 12:43:53.588130 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-dd0cc2a6-0377-4c4b-93c5-67dc8b2fd637 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.549225 Jul 26 12:43:53.588689 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 3/5] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 26 12:43:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:43:53.817170 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-9697f449-2169-4c21-847a-29eb157e4fdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:43:53.821995 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:43:53.821995 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: warnings.warn(msg) Jul 26 12:43:53.824663 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writing DB stats nova_api:SELECT=3 {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:53.825539 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writing DB stats nova_cell0:SELECT=3 {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:53.826507 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writing DB stats nova_cell1:SELECT=3 {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:53.827255 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:43:53.894530 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-9697f449-2169-4c21-847a-29eb157e4fdb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.297204 Jul 26 12:43:53.895121 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 3/6] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 26 12:43:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:43:56.166732 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-dd0cc2a6-0377-4c4b-93c5-67dc8b2fd637 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:43:56.168323 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-dd0cc2a6-0377-4c4b-93c5-67dc8b2fd637 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Jul 26 12:43:56.168873 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 4/7] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:43:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:43:56.848590 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-dd3ed7c0-6679-4fef-8bb4-29bb60a25360 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "ram": 512, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:43:56.867859 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:43:56.867859 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: warnings.warn(msg) Jul 26 12:43:56.891013 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-dd3ed7c0-6679-4fef-8bb4-29bb60a25360 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.715350 Jul 26 12:43:56.891698 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 4/8] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 26 12:43:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 12:43:56.904890 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-94b7aece-b1dc-4d79-b46d-d3806d8b4f06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:43:56.908241 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:43:56.908241 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: warnings.warn(msg) Jul 26 12:43:56.945472 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-94b7aece-b1dc-4d79-b46d-d3806d8b4f06 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044301 Jul 26 12:43:56.951841 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 5/9] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 26 12:43:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:43:59.189288 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-dd3ed7c0-6679-4fef-8bb4-29bb60a25360 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:43:59.192563 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-dd3ed7c0-6679-4fef-8bb4-29bb60a25360 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003348 Jul 26 12:43:59.193479 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:43:59 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:43:59.609191 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-ac7ca07c-01d1-4438-825c-b68565cb0e38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0, "ram": 1024, "disk": 10}} {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:43:59.629382 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-ac7ca07c-01d1-4438-825c-b68565cb0e38 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429371 Jul 26 12:43:59.629937 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 6/11] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 26 12:43:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:43:59.642331 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-760e6181-0fdc-4622-ac95-02790bd7f3ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:43:59.666566 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-760e6181-0fdc-4622-ac95-02790bd7f3ec admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027890 Jul 26 12:43:59.667333 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 6/12] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 26 12:43:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:44:01.884130 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-ac7ca07c-01d1-4438-825c-b68565cb0e38 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:01.885156 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-ac7ca07c-01d1-4438-825c-b68565cb0e38 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jul 26 12:44:01.885565 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 7/13] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:44:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:02.322591 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-7133a21e-ab82-47ba-bba6-95b856a6664c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "disk": 10, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:02.346554 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-7133a21e-ab82-47ba-bba6-95b856a6664c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.451106 Jul 26 12:44:02.346554 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 7/14] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 26 12:44:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 12:44:02.357062 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-887a9a1d-9085-40ff-a942-f3a76394c43d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:02.383531 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-887a9a1d-9085-40ff-a942-f3a76394c43d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030224 Jul 26 12:44:02.384155 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 8/15] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 26 12:44:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:44:04.673279 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-7133a21e-ab82-47ba-bba6-95b856a6664c admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:04.674618 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-7133a21e-ab82-47ba-bba6-95b856a6664c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001730 Jul 26 12:44:04.675383 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 8/16] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:44:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:05.119508 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-13b7158d-1a50-476d-aff9-d5c8181ddec5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 4, "swap": 0, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:05.140444 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-13b7158d-1a50-476d-aff9-d5c8181ddec5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458962 Jul 26 12:44:05.141143 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 9/17] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 26 12:44:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:44:05.153607 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-492ea3cc-0932-459b-86e2-fada578e3d0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:05.189165 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-492ea3cc-0932-459b-86e2-fada578e3d0b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039523 Jul 26 12:44:05.190651 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 9/18] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Jul 26 12:44:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:44:07.639548 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-13b7158d-1a50-476d-aff9-d5c8181ddec5 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:07.640581 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-13b7158d-1a50-476d-aff9-d5c8181ddec5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 26 12:44:07.640981 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 10/19] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:44:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:08.054081 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-5bdafcd5-c2fe-4bb6-ae4a-35b8180665f2 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:08.085097 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-5bdafcd5-c2fe-4bb6-ae4a-35b8180665f2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.436931 Jul 26 12:44:08.085725 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 10/20] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 26 12:44:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:44:10.637371 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-13b7158d-1a50-476d-aff9-d5c8181ddec5 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:10.638375 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-13b7158d-1a50-476d-aff9-d5c8181ddec5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 26 12:44:10.638774 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 11/21] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:44:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:11.106288 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-f63c68b0-8221-4881-be48-2ac8d92025cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:11.126862 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-f63c68b0-8221-4881-be48-2ac8d92025cc admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.481561 Jul 26 12:44:11.127667 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 11/22] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 26 12:44:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:44:11.139484 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-e4b21d84-7684-42a8-8d54-659bf48ab8c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:11.166945 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-e4b21d84-7684-42a8-8d54-659bf48ab8c5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030957 Jul 26 12:44:11.167895 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 12/23] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 26 12:44:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:44:13.574412 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-f63c68b0-8221-4881-be48-2ac8d92025cc admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:13.575420 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-f63c68b0-8221-4881-be48-2ac8d92025cc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 26 12:44:13.576007 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:44:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:44:13.985854 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-e1e7e0bb-2fac-4a74-b0f7-a26ad6dbc5b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "id": "2", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:14.005773 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-e1e7e0bb-2fac-4a74-b0f7-a26ad6dbc5b7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.423240 Jul 26 12:44:14.006239 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 13/25] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 26 12:44:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:44:14.018850 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-d90845d0-4ba4-4f20-b68f-c73e6a5f218b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:14.042907 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-d90845d0-4ba4-4f20-b68f-c73e6a5f218b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028349 Jul 26 12:44:14.043512 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 13/26] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 26 12:44:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:44:16.232839 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-e1e7e0bb-2fac-4a74-b0f7-a26ad6dbc5b7 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:16.233838 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-e1e7e0bb-2fac-4a74-b0f7-a26ad6dbc5b7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 26 12:44:16.234235 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:44:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:16.629397 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-4a4f6240-eae7-46f9-aa43-7fdd0de50d2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "swap": 0, "rxtx_factor": 1.0}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:16.651222 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-4a4f6240-eae7-46f9-aa43-7fdd0de50d2e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.410649 Jul 26 12:44:16.651790 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 14/28] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 26 12:44:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 12:44:16.663881 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-50659452-3aaa-4171-aa3b-7e5aa5fac567 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:16.690832 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-50659452-3aaa-4171-aa3b-7e5aa5fac567 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030539 Jul 26 12:44:16.691414 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 15/29] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 26 12:44:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:44:18.928189 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-4a4f6240-eae7-46f9-aa43-7fdd0de50d2e admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:18.929233 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-4a4f6240-eae7-46f9-aa43-7fdd0de50d2e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jul 26 12:44:18.929631 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 15/30] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:44:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:19.390190 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-cccad221-997b-4e47-aaff-6addee2f959d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "swap": 0, "ram": 8192, "vcpus": 4}} {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:19.418262 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-cccad221-997b-4e47-aaff-6addee2f959d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.482730 Jul 26 12:44:19.419387 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 16/31] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 26 12:44:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:44:19.431075 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-ff177a64-3b71-44e3-88a7-648b5fb7bf1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:19.457026 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-ff177a64-3b71-44e3-88a7-648b5fb7bf1a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029622 Jul 26 12:44:19.467688 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 16/32] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 26 12:44:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:44:21.805617 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-cccad221-997b-4e47-aaff-6addee2f959d admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:21.806969 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-cccad221-997b-4e47-aaff-6addee2f959d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001732 Jul 26 12:44:21.808089 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:44:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:22.244873 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-c6ce392e-9fe9-4026-9357-af3a64334e18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:22.269560 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-c6ce392e-9fe9-4026-9357-af3a64334e18 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.455075 Jul 26 12:44:22.277080 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 17/34] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Jul 26 12:44:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:44:22.281935 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-ea3f5c1f-2a1c-4014-b77b-a94f2999bf82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:22.290654 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG dbcounter [-] [114789] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=114789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:22.310167 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-ea3f5c1f-2a1c-4014-b77b-a94f2999bf82 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031844 Jul 26 12:44:22.311065 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 18/35] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Jul 26 12:44:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:44:42.422820 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-c6ce392e-9fe9-4026-9357-af3a64334e18 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:42.423854 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-c6ce392e-9fe9-4026-9357-af3a64334e18 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Jul 26 12:44:42.424257 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:44:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:42.809034 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-8bd06ec1-fb5b-47c6-a831-7ebe21800e9f admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:42.827483 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-8bd06ec1-fb5b-47c6-a831-7ebe21800e9f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397271 Jul 26 12:44:42.828055 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 19/37] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 26 12:44:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:44:44.034515 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-c6ce392e-9fe9-4026-9357-af3a64334e18 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:44.035513 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-c6ce392e-9fe9-4026-9357-af3a64334e18 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 26 12:44:44.035947 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 19/38] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 26 12:44:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:44.561991 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-ce1a4700-5f5e-415c-bdc9-ec7a7fd4f855 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:44.567728 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.wsgi [None req-ce1a4700-5f5e-415c-bdc9-ec7a7fd4f855 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-ce1a4700-5f5e-415c-bdc9-ec7a7fd4f855 admin admin] Request method failure captured: Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Accept: application/json Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Accept-Encoding: gzip, deflate Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Connection: keep-alive Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Content-Length: 0 Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Host: 10.222.0.20 Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Openstack-Api-Version: compute 2.90 Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Openstack-System-Scope: None Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: User-Agent: python-novaclient Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Auth-Token: gAAAAABi3-G7lkY4vOR6koA7ygfDHsNfWg5C6o5KDBO5JlhOGOIHxXP82fUeyWA7l1v7Y4dLtZ1KA2_gRpj4uCdV7_73bQuzXipGVVmUzRoyJNCvfPQJh77e1VlCcUPv4cWowNIZkH4XqWpS-vjr0Qal7j7LHVej-jlSUEqrM8k8YcqGfSaB7u0 Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Domain-Id: None Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Domain-Name: None Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Identity-Status: Confirmed Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Is-Admin-Project: True Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Project-Domain-Id: default Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Project-Domain-Name: Default Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Project-Id: 1ca671277c17458082e4383a242d5404 Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Project-Name: admin Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Role: admin,member,reader Jul 26 12:44:44.570959 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Roles: admin,member,reader Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ca671277c17458082e4383a242d5404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ca671277c17458082e4383a242d5404", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca671277c17458082e4383a242d5404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca671277c17458082e4383a242d5404"}]}] Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Tenant: admin Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Tenant-Id: 1ca671277c17458082e4383a242d5404 Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Tenant-Name: admin Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User: admin Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User-Domain-Id: default Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User-Domain-Name: Default Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User-Id: 26e313f5057b4411a71a6bd67e68cb0e Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User-Name: admin Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: method: > Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: exception: Flavor 42 could not be found. Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: action_args: {'id': '42'} Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:44:44.572976 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:44:44.573833 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:44.574920 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-ce1a4700-5f5e-415c-bdc9-ec7a7fd4f855 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:44:44.576202 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-ce1a4700-5f5e-415c-bdc9-ec7a7fd4f855 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397832 Jul 26 12:44:44.576202 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 20/39] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 26 12:44:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 26 12:44:44.582587 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-871aeae3-57a0-4e64-b30a-3de27ecb2cea admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:44.586664 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:44:44.606945 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-871aeae3-57a0-4e64-b30a-3de27ecb2cea admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028363 Jul 26 12:44:44.607525 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 26 12:44:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:44:44.617497 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-5db14e1e-a63e-47f7-be41-8639669c98cc admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:44.642291 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-5db14e1e-a63e-47f7-be41-8639669c98cc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028370 Jul 26 12:44:44.642834 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 26 12:44:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:44:44.653088 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-07052aac-a35d-4859-9823-02ed9c5e39ca admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:44.659916 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.wsgi [None req-07052aac-a35d-4859-9823-02ed9c5e39ca admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-07052aac-a35d-4859-9823-02ed9c5e39ca admin admin] Request method failure captured: Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Accept: application/json Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Accept-Encoding: gzip, deflate Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Connection: keep-alive Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Content-Length: 0 Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Host: 10.222.0.20 Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Openstack-Api-Version: compute 2.90 Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Openstack-System-Scope: None Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: User-Agent: python-novaclient Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Auth-Token: gAAAAABi3-G7lkY4vOR6koA7ygfDHsNfWg5C6o5KDBO5JlhOGOIHxXP82fUeyWA7l1v7Y4dLtZ1KA2_gRpj4uCdV7_73bQuzXipGVVmUzRoyJNCvfPQJh77e1VlCcUPv4cWowNIZkH4XqWpS-vjr0Qal7j7LHVej-jlSUEqrM8k8YcqGfSaB7u0 Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Domain-Id: None Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Domain-Name: None Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Identity-Status: Confirmed Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Is-Admin-Project: True Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Project-Domain-Id: default Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Project-Domain-Name: Default Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Project-Id: 1ca671277c17458082e4383a242d5404 Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Project-Name: admin Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Role: admin,member,reader Jul 26 12:44:44.663163 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Roles: admin,member,reader Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ca671277c17458082e4383a242d5404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ca671277c17458082e4383a242d5404", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca671277c17458082e4383a242d5404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca671277c17458082e4383a242d5404"}]}] Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Tenant: admin Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Tenant-Id: 1ca671277c17458082e4383a242d5404 Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Tenant-Name: admin Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User: admin Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User-Domain-Id: default Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User-Domain-Name: Default Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User-Id: 26e313f5057b4411a71a6bd67e68cb0e Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User-Name: admin Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: method: > Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: exception: Flavor 42 could not be found. Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: action_args: {'id': '42'} Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:44:44.664745 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:44:44.665692 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:44.667102 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-07052aac-a35d-4859-9823-02ed9c5e39ca admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:44:44.668332 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-07052aac-a35d-4859-9823-02ed9c5e39ca admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015888 Jul 26 12:44:44.668332 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 21/42] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 26 12:44:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 26 12:44:45.632697 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-5db14e1e-a63e-47f7-be41-8639669c98cc admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:45.633708 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-5db14e1e-a63e-47f7-be41-8639669c98cc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 26 12:44:45.634130 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 22/43] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 26 12:44:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:46.177585 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-aad97f56-06e3-46bd-bdee-c237c7eb9ee6 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:46.185136 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.wsgi [None req-aad97f56-06e3-46bd-bdee-c237c7eb9ee6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-aad97f56-06e3-46bd-bdee-c237c7eb9ee6 admin admin] Request method failure captured: Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Accept: application/json Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Accept-Encoding: gzip, deflate Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Connection: keep-alive Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Content-Length: 0 Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Host: 10.222.0.20 Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Openstack-Api-Version: compute 2.90 Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Openstack-System-Scope: None Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: User-Agent: python-novaclient Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Auth-Token: gAAAAABi3-G9E0sVrKZkNBHzPseR4DJu7xOM-NijR2P-7dr8W0W1x-J_Nk9LopVpSkvrtuirelvJN_8VvGaTUabB9_7qdd3sQdGq92_ml3JFglcG5Ws2ucy1gp8JCE2kcQqIRAqEeBy6V-Y8CC2NpGt8x4aK0rCzXTCdXXK4ubiJo3JAaNy0HtE Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Domain-Id: None Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Domain-Name: None Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Identity-Status: Confirmed Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Is-Admin-Project: True Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Project-Domain-Id: default Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Project-Domain-Name: Default Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Project-Id: 1ca671277c17458082e4383a242d5404 Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Project-Name: admin Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Role: admin,member,reader Jul 26 12:44:46.186644 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Roles: admin,member,reader Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ca671277c17458082e4383a242d5404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ca671277c17458082e4383a242d5404", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca671277c17458082e4383a242d5404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca671277c17458082e4383a242d5404"}]}] Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Tenant: admin Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Tenant-Id: 1ca671277c17458082e4383a242d5404 Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Tenant-Name: admin Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User: admin Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User-Domain-Id: default Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User-Domain-Name: Default Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User-Id: 26e313f5057b4411a71a6bd67e68cb0e Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User-Name: admin Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: method: > Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: exception: Flavor 84 could not be found. Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: action_args: {'id': '84'} Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:44:46.188148 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:44:46.189218 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:46.190541 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-aad97f56-06e3-46bd-bdee-c237c7eb9ee6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:44:46.191749 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-aad97f56-06e3-46bd-bdee-c237c7eb9ee6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.416710 Jul 26 12:44:46.191749 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 26 12:44:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:46.197722 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-ba341f34-6cb2-4535-830e-e8fb04d5c33f admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:46.213195 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-ba341f34-6cb2-4535-830e-e8fb04d5c33f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019070 Jul 26 12:44:46.213748 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 26 12:44:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:44:46.223862 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-ea9f3c2c-386f-45a4-a7ad-4918776ae4f5 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:46.238919 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-ea9f3c2c-386f-45a4-a7ad-4918776ae4f5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018574 Jul 26 12:44:46.239451 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 26 12:44:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:44:46.249066 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-7d5d847c-7300-47ab-ad4e-e2ad6fc23627 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:46.254865 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.wsgi [None req-7d5d847c-7300-47ab-ad4e-e2ad6fc23627 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-7d5d847c-7300-47ab-ad4e-e2ad6fc23627 admin admin] Request method failure captured: Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Accept: application/json Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Accept-Encoding: gzip, deflate Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Connection: keep-alive Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Content-Length: 0 Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Host: 10.222.0.20 Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Openstack-Api-Version: compute 2.90 Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Openstack-System-Scope: None Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: User-Agent: python-novaclient Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Auth-Token: gAAAAABi3-G9E0sVrKZkNBHzPseR4DJu7xOM-NijR2P-7dr8W0W1x-J_Nk9LopVpSkvrtuirelvJN_8VvGaTUabB9_7qdd3sQdGq92_ml3JFglcG5Ws2ucy1gp8JCE2kcQqIRAqEeBy6V-Y8CC2NpGt8x4aK0rCzXTCdXXK4ubiJo3JAaNy0HtE Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Domain-Id: None Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Domain-Name: None Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Identity-Status: Confirmed Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Is-Admin-Project: True Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Project-Domain-Id: default Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Project-Domain-Name: Default Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Project-Id: 1ca671277c17458082e4383a242d5404 Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Project-Name: admin Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Role: admin,member,reader Jul 26 12:44:46.256377 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Roles: admin,member,reader Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ca671277c17458082e4383a242d5404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ca671277c17458082e4383a242d5404", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca671277c17458082e4383a242d5404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca671277c17458082e4383a242d5404"}]}] Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Tenant: admin Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Tenant-Id: 1ca671277c17458082e4383a242d5404 Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Tenant-Name: admin Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User: admin Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User-Domain-Id: default Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User-Domain-Name: Default Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User-Id: 26e313f5057b4411a71a6bd67e68cb0e Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User-Name: admin Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: method: > Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: exception: Flavor 84 could not be found. Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: action_args: {'id': '84'} Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:44:46.257736 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:44:46.258556 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:46.259797 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-7d5d847c-7300-47ab-ad4e-e2ad6fc23627 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:44:46.261024 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-7d5d847c-7300-47ab-ad4e-e2ad6fc23627 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012458 Jul 26 12:44:46.261024 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 24/47] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Jul 26 12:44:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:47.233063 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-ea9f3c2c-386f-45a4-a7ad-4918776ae4f5 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:47.234110 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-ea9f3c2c-386f-45a4-a7ad-4918776ae4f5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 26 12:44:47.235131 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 24/48] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 26 12:44:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:47.761043 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-76c4fe22-6dfc-4f52-a882-46327e52d4f0 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:47.767408 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.wsgi [None req-76c4fe22-6dfc-4f52-a882-46327e52d4f0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-76c4fe22-6dfc-4f52-a882-46327e52d4f0 admin admin] Request method failure captured: Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Accept: application/json Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Accept-Encoding: gzip, deflate Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Connection: keep-alive Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Content-Length: 0 Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Host: 10.222.0.20 Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Openstack-Api-Version: compute 2.90 Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Openstack-System-Scope: None Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: User-Agent: python-novaclient Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Auth-Token: gAAAAABi3-G_QNEQYIdNt9yd1l9pPuZ1h4OyjrAdAijcQ_DPruYfwYdt-4bdn0I5zwQMmlqkYFtc_b1S9IX846p30bY2Rq6rM4Hw6Xy_vXbGki5yUKqSVMrlZOOsCA_fmAyVdkwzqKarqV1F-HfxF0vioW1Bi0jh70fbd0ty4Chza6cPKal07bo Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Domain-Id: None Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Domain-Name: None Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Identity-Status: Confirmed Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Is-Admin-Project: True Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Project-Domain-Id: default Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Project-Domain-Name: Default Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Project-Id: 1ca671277c17458082e4383a242d5404 Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Project-Name: admin Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Role: admin,member,reader Jul 26 12:44:47.768948 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Roles: admin,member,reader Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ca671277c17458082e4383a242d5404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ca671277c17458082e4383a242d5404", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca671277c17458082e4383a242d5404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca671277c17458082e4383a242d5404"}]}] Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Tenant: admin Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Tenant-Id: 1ca671277c17458082e4383a242d5404 Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-Tenant-Name: admin Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User: admin Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User-Domain-Id: default Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User-Domain-Name: Default Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User-Id: 26e313f5057b4411a71a6bd67e68cb0e Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: X-User-Name: admin Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: method: > Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: exception: Flavor 451 could not be found. Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: action_args: {'id': '451'} Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:44:47.770507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:44:47.771571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: ERROR nova.api.openstack.wsgi Jul 26 12:44:47.772915 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-76c4fe22-6dfc-4f52-a882-46327e52d4f0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114789) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:44:47.774229 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-76c4fe22-6dfc-4f52-a882-46327e52d4f0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.397798 Jul 26 12:44:47.774229 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 25/49] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 26 12:44:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:47.780103 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-64629488-c90b-445d-96bc-916915a36b51 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:47.794740 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-64629488-c90b-445d-96bc-916915a36b51 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018182 Jul 26 12:44:47.795259 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 25/50] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 26 12:44:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:44:47.804857 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:47.820554 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019276 Jul 26 12:44:47.821073 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 26/51] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Jul 26 12:44:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:44:47.830871 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-c562b9fa-c8d8-4a78-8419-9c78d98e779f admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:47.836333 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.wsgi [None req-c562b9fa-c8d8-4a78-8419-9c78d98e779f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-c562b9fa-c8d8-4a78-8419-9c78d98e779f admin admin] Request method failure captured: Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Accept: application/json Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Accept-Encoding: gzip, deflate Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Connection: keep-alive Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Content-Length: 0 Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Host: 10.222.0.20 Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Openstack-Api-Version: compute 2.90 Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Openstack-System-Scope: None Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: User-Agent: python-novaclient Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Auth-Token: gAAAAABi3-G_QNEQYIdNt9yd1l9pPuZ1h4OyjrAdAijcQ_DPruYfwYdt-4bdn0I5zwQMmlqkYFtc_b1S9IX846p30bY2Rq6rM4Hw6Xy_vXbGki5yUKqSVMrlZOOsCA_fmAyVdkwzqKarqV1F-HfxF0vioW1Bi0jh70fbd0ty4Chza6cPKal07bo Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Domain-Id: None Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Domain-Name: None Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Identity-Status: Confirmed Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Is-Admin-Project: True Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Project-Domain-Id: default Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Project-Domain-Name: Default Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Project-Id: 1ca671277c17458082e4383a242d5404 Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Project-Name: admin Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Role: admin,member,reader Jul 26 12:44:47.837828 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Roles: admin,member,reader Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ca671277c17458082e4383a242d5404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ca671277c17458082e4383a242d5404", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca671277c17458082e4383a242d5404"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ca671277c17458082e4383a242d5404"}]}] Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Tenant: admin Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Tenant-Id: 1ca671277c17458082e4383a242d5404 Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-Tenant-Name: admin Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User: admin Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User-Domain-Id: default Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User-Domain-Name: Default Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User-Id: 26e313f5057b4411a71a6bd67e68cb0e Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: X-User-Name: admin Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: method: > Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: exception: Flavor 451 could not be found. Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: action_args: {'id': '451'} Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:44:47.839453 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:44:47.840402 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: ERROR nova.api.openstack.wsgi Jul 26 12:44:47.841694 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-c562b9fa-c8d8-4a78-8419-9c78d98e779f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114790) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:44:47.842944 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-c562b9fa-c8d8-4a78-8419-9c78d98e779f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012518 Jul 26 12:44:47.842944 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 26/52] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 26 12:44:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 12:44:48.809228 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:48.810230 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 26 12:44:48.810613 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 26 12:44:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:49.340869 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-54f901ee-6c43-4b5f-800d-e5d2911f627e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:49.360522 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-54f901ee-6c43-4b5f-800d-e5d2911f627e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.406082 Jul 26 12:44:49.361117 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 27/54] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 26 12:44:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:44:50.325850 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:50.326872 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 26 12:44:50.327299 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 26 12:44:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:50.852519 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-59659742-1eef-4323-a0f7-913221142ed1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:50.870140 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-59659742-1eef-4323-a0f7-913221142ed1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.404728 Jul 26 12:44:50.870672 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 28/56] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 26 12:44:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:44:51.871386 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:51.872682 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 26 12:44:51.873088 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 26 12:44:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:52.417193 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-dee3681f-272f-4aa8-a6fd-88a49e79113a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:52.436342 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-dee3681f-272f-4aa8-a6fd-88a49e79113a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.412198 Jul 26 12:44:52.436795 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 29/58] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 26 12:44:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:44:53.420893 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:53.422439 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001966 Jul 26 12:44:53.422841 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 30/59] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 26 12:44:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:53.956278 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-9127ba44-f53a-4d0e-887c-3e11ccc9ab5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:44:53.974238 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-9127ba44-f53a-4d0e-887c-3e11ccc9ab5c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.413617 Jul 26 12:44:53.974781 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 30/60] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Jul 26 12:44:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:44:54.950566 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:54.951571 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 26 12:44:54.952011 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 31/61] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 26 12:44:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:44:55.479551 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-718fb157-d6bc-4b47-8bda-0af80c98b729 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:44:55.500702 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-718fb157-d6bc-4b47-8bda-0af80c98b729 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410075 Jul 26 12:44:55.501168 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 31/62] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Jul 26 12:44:55 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:45:47.236877 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:45:47.237890 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-b9056d89-6213-4dcd-960f-ff3a7806c7a7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 26 12:45:47.238286 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 930 bytes} [Tue Jul 26 12:45:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:45:47.248969 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:47.627700 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-aaac1188-7796-426e-882a-d03934a1b381 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:45:47.648373 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-aaac1188-7796-426e-882a-d03934a1b381 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404041 Jul 26 12:45:47.648916 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 32/64] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Jul 26 12:45:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:45:47.672266 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-cee91644-8e81-4112-ab1a-3cf3ad905eb1 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:45:47.675706 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG dbcounter [-] [114789] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=114789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:45:47.682086 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-cee91644-8e81-4112-ab1a-3cf3ad905eb1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013538 Jul 26 12:45:47.682618 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 33/65] 10.222.0.20 () {60 vars in 1282 bytes} [Tue Jul 26 12:45:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:45:47.694517 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-8103a32b-29b7-4159-ac52-bcee64889d86 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:45:47.702723 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-8103a32b-29b7-4159-ac52-bcee64889d86 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011850 Jul 26 12:45:47.703241 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 33/66] 10.222.0.20 () {60 vars in 1285 bytes} [Tue Jul 26 12:45:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:45:47.714961 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-fadf991b-09fd-43b0-bc02-bdcd51abb9f2 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:45:47.723875 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-fadf991b-09fd-43b0-bc02-bdcd51abb9f2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012815 Jul 26 12:45:47.724393 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 34/67] 10.222.0.20 () {60 vars in 1285 bytes} [Tue Jul 26 12:45:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:45:47.735606 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-a4bfe187-3e54-403d-80dc-e3b7c3b35944 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:45:47.743156 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-a4bfe187-3e54-403d-80dc-e3b7c3b35944 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011013 Jul 26 12:45:47.743678 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 34/68] 10.222.0.20 () {60 vars in 1282 bytes} [Tue Jul 26 12:45:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:49:12.933436 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-fadf991b-09fd-43b0-bc02-bdcd51abb9f2 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:49:12.934444 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-fadf991b-09fd-43b0-bc02-bdcd51abb9f2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 26 12:49:12.934839 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 26 12:49:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:49:13.076876 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writing DB stats nova_api:SELECT=6 {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:49:13.238532 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-a87db38c-f449-4a1d-8a0c-100ca5616679 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:49:13.241191 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:49:13.241191 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: warnings.warn(msg) Jul 26 12:49:13.242944 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-a87db38c-f449-4a1d-8a0c-100ca5616679 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:49:13.243664 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-a87db38c-f449-4a1d-8a0c-100ca5616679 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:49:13.244840 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-a87db38c-f449-4a1d-8a0c-100ca5616679 admin admin] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:49:13.245408 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-a87db38c-f449-4a1d-8a0c-100ca5616679 admin admin] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:49:13.280685 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-a87db38c-f449-4a1d-8a0c-100ca5616679 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205349 Jul 26 12:49:13.281263 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 35/70] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 26 12:49:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:49:14.108251 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-fadf991b-09fd-43b0-bc02-bdcd51abb9f2 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:49:14.109266 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-fadf991b-09fd-43b0-bc02-bdcd51abb9f2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 26 12:49:14.109659 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 26 12:49:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:49:14.306039 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-12a5c89b-7973-4349-a89c-16bf09fb7dec admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:49:14.308483 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:49:14.308483 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: warnings.warn(msg) Jul 26 12:49:14.309609 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-12a5c89b-7973-4349-a89c-16bf09fb7dec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:49:14.310045 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-12a5c89b-7973-4349-a89c-16bf09fb7dec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:49:14.310816 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-12a5c89b-7973-4349-a89c-16bf09fb7dec admin admin] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:49:14.311237 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-12a5c89b-7973-4349-a89c-16bf09fb7dec admin admin] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:49:14.334860 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-12a5c89b-7973-4349-a89c-16bf09fb7dec admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083938 Jul 26 12:49:14.336083 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 36/72] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 26 12:49:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:49:25.579493 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-fadf991b-09fd-43b0-bc02-bdcd51abb9f2 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:49:25.580507 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-fadf991b-09fd-43b0-bc02-bdcd51abb9f2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 26 12:49:25.580898 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 26 12:49:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:49:25.725451 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writing DB stats nova_cell0:SELECT=4 {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:49:25.726166 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writing DB stats nova_cell1:SELECT=4 {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:49:25.726799 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG dbcounter [-] [114790] Writing DB stats nova_api:SELECT=8 {{(pid=114790) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:49:25.774726 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-b4b7ea09-59e0-45f9-8516-d880e9eb0f78 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:49:25.777127 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:49:25.777127 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: warnings.warn(msg) Jul 26 12:49:25.778317 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-b4b7ea09-59e0-45f9-8516-d880e9eb0f78 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:49:25.778753 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-b4b7ea09-59e0-45f9-8516-d880e9eb0f78 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:49:25.779527 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-b4b7ea09-59e0-45f9-8516-d880e9eb0f78 admin admin] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:49:25.779989 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-b4b7ea09-59e0-45f9-8516-d880e9eb0f78 admin admin] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:49:25.804380 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-b4b7ea09-59e0-45f9-8516-d880e9eb0f78 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083283 Jul 26 12:49:25.804840 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 37/74] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 26 12:49:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:49:26.637184 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: DEBUG nova.api.openstack.wsgi [None req-fadf991b-09fd-43b0-bc02-bdcd51abb9f2 admin admin] Calling method '>' {{(pid=114789) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:49:26.638187 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: INFO nova.api.openstack.requestlog [None req-fadf991b-09fd-43b0-bc02-bdcd51abb9f2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 26 12:49:26.638583 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: [pid: 114789|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Jul 26 12:49:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:49:26.827051 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG nova.api.openstack.wsgi [None req-951a93f5-d74b-449e-bad6-77516c1e9e46 admin admin] Calling method '>' {{(pid=114790) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:49:26.829428 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 12:49:26.829428 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: warnings.warn(msg) Jul 26 12:49:26.830634 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-951a93f5-d74b-449e-bad6-77516c1e9e46 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:49:26.831067 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-951a93f5-d74b-449e-bad6-77516c1e9e46 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:49:26.831900 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-951a93f5-d74b-449e-bad6-77516c1e9e46 admin admin] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:49:26.832320 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: DEBUG oslo_concurrency.lockutils [None req-951a93f5-d74b-449e-bad6-77516c1e9e46 admin admin] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114790) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:49:26.854729 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: INFO nova.api.openstack.requestlog [None req-951a93f5-d74b-449e-bad6-77516c1e9e46 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078329 Jul 26 12:49:26.855209 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: [pid: 114790|app: 0|req: 38/76] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Jul 26 12:49:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:50:22.701784 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: Tue Jul 26 12:50:22 2022 - graceful shutdown triggered... Jul 26 12:50:22.701831 dv-cinder-850939-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 26 12:50:22.702852 dv-cinder-850939-2-iscsi devstack@n-api.service[114789]: Gracefully killing worker 1 (pid: 114789)... Jul 26 12:50:22.703293 dv-cinder-850939-2-iscsi devstack@n-api.service[114790]: Gracefully killing worker 2 (pid: 114790)... Jul 26 12:50:23.703973 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: worker 1 buried after 1 seconds Jul 26 12:50:23.703973 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: worker 2 buried after 1 seconds Jul 26 12:50:23.704605 dv-cinder-850939-2-iscsi devstack@n-api.service[114788]: goodbye to uWSGI. Jul 26 12:50:23.705524 dv-cinder-850939-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 26 12:50:23.706069 dv-cinder-850939-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 26 12:50:23.708875 dv-cinder-850939-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 12:50:23.718801 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 12:50:23.721420 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 12:50:23 2022] *** Jul 26 12:50:23.721582 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 12:50:23.721715 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 12:50:23.721845 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: nodename: dv-cinder-850939-2-iscsi Jul 26 12:50:23.721845 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: machine: x86_64 Jul 26 12:50:23.721845 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: clock source: unix Jul 26 12:50:23.721845 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: pcre jit disabled Jul 26 12:50:23.721845 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: detected number of CPU cores: 4 Jul 26 12:50:23.721845 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: current working directory: / Jul 26 12:50:23.721845 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: detected binary path: /usr/bin/uwsgi-core Jul 26 12:50:23.721845 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: your processes number limit is 47680 Jul 26 12:50:23.721845 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: your memory page size is 4096 bytes Jul 26 12:50:23.721845 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: detected max file descriptor number: 2048 Jul 26 12:50:23.722522 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: lock engine: pthread robust mutexes Jul 26 12:50:23.722522 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: thunder lock: enabled Jul 26 12:50:23.722837 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 12:50:23.722919 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 12:50:23.764288 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: Python main interpreter initialized at 0x55f38ca2b9c0 Jul 26 12:50:23.764288 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: python threads support enabled Jul 26 12:50:23.764288 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: your server socket listen backlog is limited to 100 connections Jul 26 12:50:23.764288 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: your mercy for graceful operations on workers is 90 seconds Jul 26 12:50:23.764728 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 12:50:23.764728 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: *** Operational MODE: preforking *** Jul 26 12:50:23.765021 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: *** uWSGI is running in multiple interpreter mode *** Jul 26 12:50:23.765021 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: spawned uWSGI master process (pid: 129295) Jul 26 12:50:23.765350 dv-cinder-850939-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 12:50:23.765816 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: spawned uWSGI worker 1 (pid: 129307, cores: 1) Jul 26 12:50:23.766173 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: spawned uWSGI worker 2 (pid: 129308, cores: 1) Jul 26 12:50:23.766554 dv-cinder-850939-2-iscsi devstack@n-api.service[129295]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 12:50:24.420180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 12:50:24.433152 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 12:50:25.563653 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 12:50:25.563653 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: from cryptography.utils import int_from_bytes Jul 26 12:50:25.564300 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 12:50:25.564300 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: from cryptography.utils import int_from_bytes Jul 26 12:50:25.612273 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 12:50:25.612273 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: from cryptography.utils import int_from_bytes Jul 26 12:50:25.612853 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 12:50:25.612853 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: from cryptography.utils import int_from_bytes Jul 26 12:50:27.971407 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 12:50:27.972067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 12:50:27.972209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 12:50:27.972568 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 12:50:27.972823 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 12:50:27.973208 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.973533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.973852 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.974170 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.974506 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.974817 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.975136 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.975455 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.975970 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.976242 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.976558 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.976886 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850939-2-iscsi {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.977245 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.977693 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.978011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.978339 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.978651 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.978978 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.979286 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.979830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.980587 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.981116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.981629 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.982165 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.982683 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.983135 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.983521 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.983954 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.984252 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.984662 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.985286 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850939-2-iscsi {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.985419 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.985740 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.986162 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.986592 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.986952 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.987406 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.987797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.988062 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.988574 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.988798 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.989144 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.989466 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.989864 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.990179 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.990522 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.990944 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.991185 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.991528 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.991891 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.992403 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.992519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.993372 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.993751 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.994061 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.994377 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.994876 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.994994 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.995317 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.995834 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.996126 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.996493 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.997028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.997390 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.997719 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.998082 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.998406 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.998741 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.999121 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.999403 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:27.999798 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.000165 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.000562 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.000818 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.001127 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.001472 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.001799 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.002111 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.002455 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.002758 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.003062 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.003378 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.003708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.004030 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.004377 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.004688 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.004941 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.005248 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.005560 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.005877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.006201 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.006498 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.006805 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.007109 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.007414 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.007747 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.008058 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.008936 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.009249 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.009589 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.009868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.010179 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.010490 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.010819 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.011139 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.011449 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.011845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.012101 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.012412 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.012877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.013048 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.013360 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.013687 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.014000 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.014309 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.014630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.014939 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.015248 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.015686 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.015897 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.016205 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.016524 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.016834 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.017143 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.017450 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.017868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.018067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.018376 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.018678 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.018988 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.019292 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.019612 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.019974 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.020289 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.020599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.020906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.021228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.021576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.021915 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.022257 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.022572 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.022911 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.023234 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.023558 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.023945 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.024263 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.024589 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.024902 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.025217 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.025532 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.025852 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.026174 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.026499 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.027005 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.027329 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.027669 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.027982 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.028465 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.028801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.029131 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.029453 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.029798 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.030150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.030467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.030792 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.031120 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.031435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.031785 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.032102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.032422 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.032760 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.033081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.033400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.033714 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.034032 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.034341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.034654 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.034965 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.035309 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.035627 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.035967 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.036280 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.036597 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.036911 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.037221 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.037530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.037834 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.038138 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.038442 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.038754 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.039061 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.039388 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.039790 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.040097 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.040436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.040744 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.041059 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.041373 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.041686 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.041998 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.042311 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.042623 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.042933 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.043255 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.043584 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.043901 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.044230 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.044536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.044842 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.045161 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.045473 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.045786 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.046098 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.046413 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.046733 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.047046 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.047362 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.047726 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.048059 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.048365 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.048688 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.049014 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.049324 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.049632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.049944 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.050325 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.050546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.051248 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.051248 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.051582 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.051837 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.052054 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.052360 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.052665 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.052993 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.053297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.053601 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.053906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.054210 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.054556 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.054859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.055780 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.056194 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.056722 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.057192 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.057667 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.058141 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.058616 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.059081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.059551 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.060052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.060542 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.061004 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.061464 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.061925 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.062625 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.062948 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.063278 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.063589 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.063940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.064293 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.064635 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.064958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.065284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.065596 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.065915 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.066231 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.066544 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.066859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.067169 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.067489 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.067830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.068159 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.068463 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.068788 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.069099 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.069421 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.069728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.070043 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.070379 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.071500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.071666 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.071987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.072312 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.072629 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.072942 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.073256 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.073567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.073878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.074192 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.074509 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.074822 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.075135 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.075441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.075786 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.076099 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.076401 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.076708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.077018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.077342 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.077656 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.077982 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.078301 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.078607 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.078911 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.079233 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.079544 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.079886 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.080193 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.080498 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.080842 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.081152 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.081459 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.081949 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.082129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.082314 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 12:50:28.085664 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.085754 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 12:50:28.085833 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.085833 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.085971 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 12:50:28.086056 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.086128 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 12:50:28.087875 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.088041 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 12:50:28.088169 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.088294 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.088417 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.088417 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.088648 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.088768 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.088881 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.089068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.089193 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.089500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.089628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.089741 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.089851 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.089978 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.090090 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.090199 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.090309 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.090418 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.090528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.090649 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.090768 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.090880 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.091000 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.091117 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.091247 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850939-2-iscsi {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.091247 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.091455 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.091455 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.091693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.091824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.091995 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.092155 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.092316 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.092470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.092617 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.092781 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.092954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.093106 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.093251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.093426 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.093426 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.094022 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.094236 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.094422 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.094614 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.094814 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.095009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.095192 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.095372 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.095554 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.095881 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.096106 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.096290 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.096472 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.098384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.098592 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.098792 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.098979 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.099162 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.099365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.099779 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.099961 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.100121 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.100276 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850939-2-iscsi {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.100421 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.100574 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.100726 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.100883 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.101028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.101180 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.101331 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.101331 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.101619 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.101773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.102435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.102589 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.102734 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.102886 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.103047 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.103193 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.103345 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.103490 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.103664 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.103914 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.104269 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.104432 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.104582 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.104726 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.104877 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.105032 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.105200 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.105359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.105513 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.105658 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.105810 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.105964 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.106122 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.106274 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.106428 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.106580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.106733 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.106890 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.107043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.107214 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.107514 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.107696 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.107860 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.108015 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.108164 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.108319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.108466 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.108609 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.108761 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.108761 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.109051 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.109195 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.109397 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.109556 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.109822 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.110060 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.110224 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.110391 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.110537 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.110690 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.110690 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.110980 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.111133 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.111286 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.111440 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.111593 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.111780 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.111925 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.112070 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.112225 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.112370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.112531 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.112685 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.112830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.112981 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.113127 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.113271 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.113424 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.113576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.113728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.113892 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.114121 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.114121 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.114431 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.114578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.114730 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.114881 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.115025 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.115189 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.115339 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.115483 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.115654 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.115808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.115952 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.116112 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.116281 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.116434 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.116589 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.116733 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.116884 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.117042 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.117194 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.117339 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.118350 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.118506 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.118653 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.118813 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.118966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.119123 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.119276 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.119428 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.119587 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.119808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.120046 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.120285 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.120440 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.120597 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.120822 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.120977 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.121130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.121294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.121448 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.121601 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.122018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.122180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.122341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.122502 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.122655 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.122655 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.123575 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.123777 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.123932 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.124103 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.124343 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.124514 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.124667 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.124826 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.124987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.125139 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.125305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.125467 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.125625 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.125777 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.125947 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.126108 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.126268 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.126442 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.126594 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.126752 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.126904 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.127064 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.127223 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.127389 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.127549 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.127816 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.127994 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.128150 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.128330 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.128556 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.128729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.128889 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.129057 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.129223 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.129395 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.129967 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.130223 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.130495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.130656 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.130817 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.130970 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.131129 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.131290 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.131470 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.131630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.131868 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.132030 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.132194 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.132354 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.132521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.132674 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.132825 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.132976 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.133127 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.133318 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.133483 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.133646 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.133797 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.133797 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.134100 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.134266 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.134506 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.134721 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.134909 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.135124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.135280 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.135444 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.135598 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.135784 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.135946 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.136108 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.136260 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.136425 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.136585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.136744 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.136902 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.137053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.137212 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.137373 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.137534 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.137693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 12:50:28.137947 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.138107 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.138269 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.138437 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.138756 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.138917 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.139077 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.139237 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.139400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.139561 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.139753 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.139908 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.140078 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.140256 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.140510 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.140766 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.140934 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.141094 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.141254 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.141407 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.141568 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.141568 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.141858 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.142009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.142169 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.142169 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.142488 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.142641 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.142801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.142961 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.143112 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.143277 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.143437 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.143598 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.143797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.143968 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.144120 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.144280 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.144444 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.144690 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.144859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.145013 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.145165 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.145325 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.145325 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.145622 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.145789 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.145954 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.146117 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.146276 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.146429 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.146592 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.146744 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.146902 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.146902 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.147211 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.147363 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.147514 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.147696 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.147863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.148134 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.148344 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.148499 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.148664 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.148934 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.149105 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.149269 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.149423 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.149584 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.149744 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.149897 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.150059 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.150059 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.150359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.150613 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.150799 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.151061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.151234 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.151390 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.151549 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.151728 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.151895 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.152049 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.152252 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.152425 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.152579 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.152738 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.152891 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.153052 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.153223 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.153396 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.153549 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.153701 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.153859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.154030 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.154183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.154336 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.154487 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.154663 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.154910 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.155084 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.155248 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.155415 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.155567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.155797 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.155966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.156206 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.156206 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.156641 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.156836 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.157035 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.157240 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.157432 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.157630 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.157840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.158031 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.158343 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.158548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.158747 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.159050 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.159257 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.159447 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.159656 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.159843 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.160001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.160293 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.160454 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.160644 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.160879 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.161081 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.161349 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.161509 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.161663 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.161825 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.161997 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.162199 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.162357 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.162510 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.162510 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.162802 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.162978 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.163132 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.163285 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.163443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.163751 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.163914 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.164082 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.164236 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.164396 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.165161 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.165328 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.165481 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.165730 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.165899 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.166053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.166204 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.166374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.166546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.166707 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.166860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.167014 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.167014 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.167319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.167485 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.167667 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.167850 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.168012 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.168012 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.168333 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.168333 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.168333 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.168879 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.169061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.169292 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.169449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.169610 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.169778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.169937 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.170104 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.170263 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.170425 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.170586 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.170738 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.170906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.171137 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.171296 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.171579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.171772 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.171928 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.172080 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.172233 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.172395 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.172562 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.172715 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.172867 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.173026 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.173186 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.173346 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.173507 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.173660 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.173821 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.174000 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.175392 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.175586 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.175771 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.175925 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.176089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.176250 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.176409 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.176577 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.176732 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.176883 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.177034 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.177185 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.177345 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.177508 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.177784 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.177946 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.178100 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.178259 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.178413 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.178596 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.178844 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.179002 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.179155 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.179333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.179587 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.179809 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.179974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.180707 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.180886 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.181049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.181318 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.181479 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.181635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.181635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.182045 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.182205 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.182371 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.182533 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.182686 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.182839 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.183017 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.183170 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.183330 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.183484 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.184268 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.184438 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.184594 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.184759 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.184914 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.185066 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.185218 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.185489 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.185676 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.185832 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.185984 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.186136 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.186304 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.186461 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.186627 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.186789 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.186951 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.187104 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.187255 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.187413 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.187580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.187810 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.187976 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.188140 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.188292 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.188443 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.188443 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.188749 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.189019 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.189179 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.189339 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.189502 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.189767 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.189939 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.190103 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.190256 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.190409 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.190574 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.190728 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.190886 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.191049 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.191213 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.191540 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.191733 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.191894 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.192065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.192343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.192501 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.192663 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.192825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.192978 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.193130 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.193290 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.193290 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.193589 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.193854 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.194021 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.194175 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.194346 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.194508 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.194671 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.194825 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.194976 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.195129 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.195290 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.195471 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.195986 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.196167 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.196371 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.196581 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.196750 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.196919 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.197080 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.197241 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.197566 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.197763 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.197924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.198165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.198335 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.198499 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.198652 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.198812 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.198965 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.199292 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.199575 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.199973 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.200144 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.200299 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.200544 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.200702 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.200861 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.201014 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.201174 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.201327 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.201514 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.201762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.201940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.202103 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.202256 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.202534 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.202711 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.202867 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.203018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.203171 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.203329 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.203481 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.203481 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.203829 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.203995 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.204156 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.204156 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.204576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.204735 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.204895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.204895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.204895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.205334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.205497 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.205649 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.205810 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.206066 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.206238 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.206390 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.206556 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.206710 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.206873 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.207025 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.207184 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.207350 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.207511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.207683 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.207844 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.207996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.208158 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.208330 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.208491 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.208651 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.208651 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.208943 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.209102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.209284 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.209580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.209748 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.209903 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.210328 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.210493 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.210674 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.210914 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.211116 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.211278 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.211461 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.211651 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.211924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.212094 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.212335 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.212631 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.212910 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.213081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.213324 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.213500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.213663 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.213825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.213989 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.214143 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.214305 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.214472 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.214634 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.214794 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.214955 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.215109 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.215262 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.215422 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.215600 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.215836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.216000 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.216263 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.216423 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.216423 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.216423 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.216864 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.217024 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.217180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.217345 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.217499 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.217794 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.217974 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.218274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.218436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.218600 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.218754 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.218915 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.219076 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.219230 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.219382 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.219570 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.219870 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.220034 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.220208 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.220476 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.220642 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.220810 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.220964 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.220964 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.221253 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.221414 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.221581 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.221742 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.221914 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.222169 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.222338 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.222512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.222681 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.222850 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.223143 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.223303 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.223455 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.223609 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.223919 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.224084 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.224245 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.224458 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.224612 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.224764 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.224937 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.224937 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.225226 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.225386 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.225538 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.225701 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.225862 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.226014 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.226166 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.226402 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.226560 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.226723 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.226888 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.227594 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.227594 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.227912 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.228076 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.228257 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.228487 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.228487 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.228783 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.228945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.229098 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.229272 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.229434 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.229607 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.229760 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.230007 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.230181 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.230343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.230516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.230738 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.230899 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.231059 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.231226 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.231388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.231549 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.231724 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.231903 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.232065 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.232321 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.232485 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.232652 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.232806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.232968 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.233150 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.233150 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.233553 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.233706 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.233857 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.234010 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.234187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.234342 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.234502 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.234655 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.234807 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.234966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.235129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.235283 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.235434 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.235586 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.235827 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.235981 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.236159 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.236314 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.236466 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.236617 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.236768 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.236928 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.237080 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.237242 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.237401 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.237553 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.237712 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.237874 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.238041 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.238207 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.238373 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.238621 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.238782 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.238944 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.239105 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.239267 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.239267 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.239267 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.239712 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.239885 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.240137 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.240311 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.240464 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.240624 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.240876 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.241055 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.241193 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.241283 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.241355 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.241442 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.241524 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.241611 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.241694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.241776 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.241872 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.241966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.242060 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.242155 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.242235 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.242335 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.242409 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.242493 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.242630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.243220 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.243309 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.243571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.243689 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.243786 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.243881 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.243967 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.244056 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.244141 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.244224 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.244316 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.244400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.244485 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.244568 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.244651 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.244741 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.244834 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.244927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.245019 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.245103 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.245187 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.245278 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.245370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.245455 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.245586 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.245681 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.245773 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.245871 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.245970 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.246062 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.246155 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.246247 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.246339 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.246438 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.246523 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.246606 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.246951 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.247052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.247138 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.247138 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.247306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.247397 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.247489 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.247574 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.247686 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.247686 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.247686 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.247686 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.247686 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.248070 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.248167 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.248259 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.248344 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.248432 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.248516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.248623 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.248718 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.248718 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.248880 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.248880 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.249041 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.249041 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.249205 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.249289 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.249379 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.249472 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.249566 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.249870 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.249982 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.249982 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.250838 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.250933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.251028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.251125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.251219 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.251219 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.251385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.251477 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.251569 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.251688 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.251788 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.251883 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.251976 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.252061 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.252153 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.252246 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.252332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.252416 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.252500 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.252584 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.252688 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.252775 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.252867 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.252953 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.253037 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.253037 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.253225 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.253319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.253404 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.253845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.253962 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.254061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.254174 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.254265 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.254368 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.254495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.254593 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.254688 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.254783 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.254869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.254954 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.255044 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.255137 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.255231 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.255316 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.255408 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.255494 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.255585 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.255772 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.255872 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.255965 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.256051 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.256141 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.256227 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.256310 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.256402 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.256402 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.256402 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.256402 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.256699 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.256796 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.256888 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.256982 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.257068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.257068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.257227 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.257321 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.257321 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.257484 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.257568 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.257652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.257735 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.257735 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.257917 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.258017 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.258105 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.258227 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.258227 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.258414 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.258500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.258500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.258692 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.258835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.258835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 12:50:28.259025 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.259025 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.259025 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.259025 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.259025 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.259025 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.259025 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.259025 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.262202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.262202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.262202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.262202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.262202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.262202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.262202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.262202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.262791 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.263164 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.263590 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.264107 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.264456 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.264875 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.265294 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.265730 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.266149 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.266587 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.267026 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.267471 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.267950 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.268370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.268807 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.269234 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.269655 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.270073 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.270490 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.270945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.271361 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.271830 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.272275 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.272726 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.273149 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.273592 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.274072 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.274490 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.274924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.275359 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.275801 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.276219 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.276739 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.277065 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.277477 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.277899 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.278334 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.278753 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.279165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.279580 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.280035 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.280449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.280879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.281300 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.281715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.282130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.282547 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.282999 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.283417 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.283905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.284352 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.284788 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.285228 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.285761 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.286194 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.286622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.287060 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.287485 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.287994 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.288773 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.288773 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.289177 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.290128 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.290553 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.290983 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.291412 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.292123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.292563 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.292990 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.293418 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.293927 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.294801 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.294801 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.295170 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.295589 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.296232 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.296453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.297027 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.297433 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.297822 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.298273 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.298703 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.299132 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.299562 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.300268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.300494 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.300919 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.301335 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.301761 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.302245 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.302605 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.303027 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.303449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.303899 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.304557 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.304763 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.305736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.306168 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.306594 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.307074 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.307490 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.307942 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.308355 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.308749 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.309143 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.309870 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.310196 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.310692 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.311102 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.311504 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.311826 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO dbcounter [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] Registered counter for database nova_api Jul 26 12:50:28.311986 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.312385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.312725 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.313042 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.313360 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.313683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.314003 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.314313 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.314647 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.314965 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.315280 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.315611 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.315954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.316497 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.316852 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.317178 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.317515 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.317845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.318169 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.318482 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.318809 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.319120 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.319430 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.319777 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.320096 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.320405 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.320747 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.321063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.321378 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.321686 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.322002 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.322311 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.322645 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.322952 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.323261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.323569 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.323912 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.324223 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.324532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.324844 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.325149 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.325464 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.325773 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.326090 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.326397 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.327414 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.327414 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.327414 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.327687 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.328015 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.328308 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.328621 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.328942 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.329364 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.329690 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.330006 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.330323 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.330678 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.331004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.331567 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.332120 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.332228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_db.sqlalchemy.engines [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:50:28.333232 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.333583 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.333926 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.334247 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.334561 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.334879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.335205 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.335526 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.336171 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.336171 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.336684 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.337011 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.337330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.337713 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.337972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.338293 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.338626 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.338926 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.339106 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writer thread running {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:50:28.339241 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.339557 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.339908 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.340262 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.340781 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.341131 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.341534 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.341860 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.342175 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.342491 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.342810 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.343125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.343446 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.343808 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.344130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.344441 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.344878 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.345204 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.345529 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.345860 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.346179 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.346505 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.346832 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.347153 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.347479 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.347828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.348166 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.348518 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.348853 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.349184 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.349497 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.349806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.350116 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.350433 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.350761 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.351074 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.351384 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.351720 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.352713 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.353031 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.353343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.353654 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.353963 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.354279 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.354588 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.354897 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.355205 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.355512 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.355862 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.356182 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.356488 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.356797 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.357111 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.357417 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.357725 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.358031 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.358388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.358709 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.359029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.359354 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.359695 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.360029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.360344 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.360669 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.360994 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.361319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.361635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.361976 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.362294 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.362610 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.362928 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.363247 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.363561 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.363918 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.364260 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.364585 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.364896 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.365222 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.365542 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.365866 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.366186 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.366505 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.366831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.367146 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.367460 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.368369 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.368709 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.369013 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.369334 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.369679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.369965 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.370287 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.374214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.374214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.374214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.374214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.374214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.374214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.374214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.374214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.374848 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.374848 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.374848 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.374848 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.374848 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 12:50:28.375224 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129308) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 12:50:28.397935 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.context [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75e7599b-cac8-41c9-b1ee-f59349f865d3(cell1) {{(pid=129307) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 12:50:28.402118 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:50:28.403791 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:50:28.404537 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:50:28.406752 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:50:28.408747 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO dbcounter [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] Registered counter for database nova_cell0 Jul 26 12:50:28.412914 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO dbcounter [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] Registered counter for database nova_cell1 Jul 26 12:50:28.420856 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_db.sqlalchemy.engines [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:50:28.423096 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_db.sqlalchemy.engines [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:50:28.428265 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writer thread running {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:50:28.434332 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writer thread running {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:50:28.436602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO dbcounter [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] Registered counter for database nova_api Jul 26 12:50:28.456583 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_db.sqlalchemy.engines [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129308) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:50:28.464306 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writer thread running {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:50:28.523107 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.context [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75e7599b-cac8-41c9-b1ee-f59349f865d3(cell1) {{(pid=129308) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 12:50:28.527811 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:50:28.529388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:50:28.530199 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:50:28.532490 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:50:28.534475 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO dbcounter [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] Registered counter for database nova_cell0 Jul 26 12:50:28.538499 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO dbcounter [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] Registered counter for database nova_cell1 Jul 26 12:50:28.546314 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_db.sqlalchemy.engines [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129308) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:50:28.548586 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_db.sqlalchemy.engines [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129308) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:50:28.554285 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writer thread running {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:50:28.556063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writer thread running {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:50:28.585138 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO dbcounter [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] Registered counter for database nova_cell0 Jul 26 12:50:28.592645 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_db.sqlalchemy.engines [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:50:28.597245 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writer thread running {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:50:28.707937 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO dbcounter [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] Registered counter for database nova_cell0 Jul 26 12:50:28.715204 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_db.sqlalchemy.engines [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129308) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 12:50:28.720067 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writer thread running {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 12:50:28.915202 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: WARNING keystonemiddleware.auth_token [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 12:50:28.922443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: WARNING keystonemiddleware.auth_token [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 12:50:29.039815 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: WARNING keystonemiddleware.auth_token [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 12:50:29.047073 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: WARNING keystonemiddleware.auth_token [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 12:50:29.261164 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: WARNING keystonemiddleware.auth_token [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 12:50:29.267465 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: WARNING keystonemiddleware.auth_token [None req-aebaaee2-20eb-4e61-af67-7cc967cf0189 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 12:50:29.273040 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f38ca2b9c0 pid: 129307 (default app) Jul 26 12:50:29.394416 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: WARNING keystonemiddleware.auth_token [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 12:50:29.400611 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: WARNING keystonemiddleware.auth_token [None req-e3cc04d8-73d4-4701-a26c-67a44f796fd0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 12:50:29.406036 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f38ca2b9c0 pid: 129308 (default app) Jul 26 12:51:10.974133 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=3 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:10.975091 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=3 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:10.976161 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=3 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:10.977455 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=3 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:12.808546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4e40076d-9f25-40c9-a99e-8d2ad3e8a99c tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Action: 'create', calling method: .version_select at 0x7f65f72c5940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-738927273", "metadata": {"Type": "work"}}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4e40076d-9f25-40c9-a99e-8d2ad3e8a99c tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Request method failure captured: Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 121 Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-M-6-7bQJHN3nn3yabyTcZebqOos3j2X_J9_85QhSQtq4RSRlPvUMFCbwLWX98jAd9XA9g6Y5YCH1riSWlz29e-mjKzoe6bFf9m6cO9P-c5HwGy3g0Qmkl4Y6rlyvVOptyyDSqrLEhKbyZGuelMWHlxnFAaEO6foPTYOMyYaOnn6bA Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: f70a0bbf5d2b49e99566672e689657ba Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:51:12.830009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:51:12.831441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f70a0bbf5d2b49e99566672e689657ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f70a0bbf5d2b49e99566672e689657ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f70a0bbf5d2b49e99566672e689657ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f70a0bbf5d2b49e99566672e689657ba"}]}] Jul 26 12:51:12.831441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:12.831441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: f70a0bbf5d2b49e99566672e689657ba Jul 26 12:51:12.831441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:12.831441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-VolumesNegativeTest-562612364-project Jul 26 12:51:12.831441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:51:12.831441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:51:12.831441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: b515c2b9f1e94764ab6c3a6ddeaeb5c1 Jul 26 12:51:12.831441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-VolumesNegativeTest-562612364-project Jul 26 12:51:12.831441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Jul 26 12:51:12.831441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-738927273", "metadata": {"Type": "work"}}} Jul 26 12:51:12.831441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: Jul 26 12:51:12.831441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-738927273', 'metadata': {'Type': 'work'}}}} Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise error Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi '#$%' Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:51:12.832359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 12:51:12.834081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 12:51:12.836559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 12:51:12.836559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:12.836559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4e40076d-9f25-40c9-a99e-8d2ad3e8a99c tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:51:12.837251 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4e40076d-9f25-40c9-a99e-8d2ad3e8a99c tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.872774 Jul 26 12:51:12.838966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Jul 26 12:51:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1878 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 12:51:12.854883 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=3 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:12.856866 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=3 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:12.858133 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=3 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:12.861917 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=3 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:13.302524 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f3e11602-6674-452d-a7c8-acd569a43798 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Action: 'create', calling method: .version_select at 0x7f65f730d4c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-853221296", "metadata": {"Type": "work"}}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f3e11602-6674-452d-a7c8-acd569a43798 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Request method failure captured: Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 119 Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-M-6-7bQJHN3nn3yabyTcZebqOos3j2X_J9_85QhSQtq4RSRlPvUMFCbwLWX98jAd9XA9g6Y5YCH1riSWlz29e-mjKzoe6bFf9m6cO9P-c5HwGy3g0Qmkl4Y6rlyvVOptyyDSqrLEhKbyZGuelMWHlxnFAaEO6foPTYOMyYaOnn6bA Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: f70a0bbf5d2b49e99566672e689657ba Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:51:13.311683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:51:13.312956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f70a0bbf5d2b49e99566672e689657ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f70a0bbf5d2b49e99566672e689657ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f70a0bbf5d2b49e99566672e689657ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f70a0bbf5d2b49e99566672e689657ba"}]}] Jul 26 12:51:13.312956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:13.312956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: f70a0bbf5d2b49e99566672e689657ba Jul 26 12:51:13.312956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:13.312956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-VolumesNegativeTest-562612364-project Jul 26 12:51:13.312956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:51:13.312956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:51:13.312956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: b515c2b9f1e94764ab6c3a6ddeaeb5c1 Jul 26 12:51:13.312956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-VolumesNegativeTest-562612364-project Jul 26 12:51:13.312956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Jul 26 12:51:13.312956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-853221296", "metadata": {"Type": "work"}}} Jul 26 12:51:13.312956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: Jul 26 12:51:13.312956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-853221296', 'metadata': {'Type': 'work'}}}} Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise error Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi '0' Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:51:13.313895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 12:51:13.315452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 12:51:13.316745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 12:51:13.316745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.318211 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f3e11602-6674-452d-a7c8-acd569a43798 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:51:13.320016 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f3e11602-6674-452d-a7c8-acd569a43798 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.472085 Jul 26 12:51:13.321265 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 1/2] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Jul 26 12:51:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 476 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 12:51:13.346308 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-0d815906-bec2-4a85-b9ed-5ca2b4594bf5 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Action: 'create', calling method: .version_select at 0x7f65f72c59d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-48718087", "metadata": {"Type": "work"}}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-0d815906-bec2-4a85-b9ed-5ca2b4594bf5 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Request method failure captured: Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 117 Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-M-6-7bQJHN3nn3yabyTcZebqOos3j2X_J9_85QhSQtq4RSRlPvUMFCbwLWX98jAd9XA9g6Y5YCH1riSWlz29e-mjKzoe6bFf9m6cO9P-c5HwGy3g0Qmkl4Y6rlyvVOptyyDSqrLEhKbyZGuelMWHlxnFAaEO6foPTYOMyYaOnn6bA Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: f70a0bbf5d2b49e99566672e689657ba Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:51:13.355018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:51:13.356516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f70a0bbf5d2b49e99566672e689657ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f70a0bbf5d2b49e99566672e689657ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f70a0bbf5d2b49e99566672e689657ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f70a0bbf5d2b49e99566672e689657ba"}]}] Jul 26 12:51:13.356516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:13.356516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: f70a0bbf5d2b49e99566672e689657ba Jul 26 12:51:13.356516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:13.356516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-VolumesNegativeTest-562612364-project Jul 26 12:51:13.356516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:51:13.356516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:51:13.356516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: b515c2b9f1e94764ab6c3a6ddeaeb5c1 Jul 26 12:51:13.356516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-VolumesNegativeTest-562612364-project Jul 26 12:51:13.356516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Jul 26 12:51:13.356516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-48718087", "metadata": {"Type": "work"}}} Jul 26 12:51:13.356516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: Jul 26 12:51:13.356516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-48718087', 'metadata': {'Type': 'work'}}}} Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise error Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi '' Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:51:13.357443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 12:51:13.359069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 12:51:13.361716 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 12:51:13.361716 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:13.361716 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-0d815906-bec2-4a85-b9ed-5ca2b4594bf5 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:51:13.361716 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-0d815906-bec2-4a85-b9ed-5ca2b4594bf5 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025956 Jul 26 12:51:13.361716 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Jul 26 12:51:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 12:51:13.389870 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-57596be2-6c07-45e2-a354-3f59410a1c4e tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Calling method '.version_select at 0x7f65f730dd30>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:14.084286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-57596be2-6c07-45e2-a354-3f59410a1c4e tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] HTTP exception thrown: Volume tempest-invalid-1311117098 could not be found. Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-57596be2-6c07-45e2-a354-3f59410a1c4e tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Request method failure captured: Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1311117098 HTTP/1.1 Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-M-6-7bQJHN3nn3yabyTcZebqOos3j2X_J9_85QhSQtq4RSRlPvUMFCbwLWX98jAd9XA9g6Y5YCH1riSWlz29e-mjKzoe6bFf9m6cO9P-c5HwGy3g0Qmkl4Y6rlyvVOptyyDSqrLEhKbyZGuelMWHlxnFAaEO6foPTYOMyYaOnn6bA Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: f70a0bbf5d2b49e99566672e689657ba Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:51:14.089261 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:51:14.090552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f70a0bbf5d2b49e99566672e689657ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f70a0bbf5d2b49e99566672e689657ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f70a0bbf5d2b49e99566672e689657ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f70a0bbf5d2b49e99566672e689657ba"}]}] Jul 26 12:51:14.090552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:14.090552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: f70a0bbf5d2b49e99566672e689657ba Jul 26 12:51:14.090552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:14.090552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-VolumesNegativeTest-562612364-project Jul 26 12:51:14.090552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:51:14.090552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:51:14.090552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: b515c2b9f1e94764ab6c3a6ddeaeb5c1 Jul 26 12:51:14.090552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-VolumesNegativeTest-562612364-project Jul 26 12:51:14.090552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: Jul 26 12:51:14.090552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Volume tempest-invalid-1311117098 could not be found. Jul 26 12:51:14.090552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': 'tempest-invalid-1311117098'} Jul 26 12:51:14.090552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1311117098 could not be found. (HTTP 404) (Request-ID: req-305a3d20-528a-44e6-87e4-818db9100949) Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:14.091330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 12:51:14.092495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1311117098 could not be found. Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:51:14.093697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1311117098 could not be found. Jul 26 12:51:14.094828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.094828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:14.094828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.094828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:14.094828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:51:14.094828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:51:14.094828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:51:14.094828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:51:14.094828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1311117098 could not be found. Jul 26 12:51:14.094828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.094828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-57596be2-6c07-45e2-a354-3f59410a1c4e tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Returning 404 to user: Volume tempest-invalid-1311117098 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:51:14.094828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-57596be2-6c07-45e2-a354-3f59410a1c4e tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1311117098" status: 404 len: 99 microversion: 2.1 time: 0.723623 Jul 26 12:51:14.102139 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Jul 26 12:51:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1311117098 => generated 99 bytes in 730 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 26 12:51:14.107247 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-699b209c-028a-4365-9492-eae4b5e94ff9 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004028 Jul 26 12:51:14.112291 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Jul 26 12:51:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 12:51:14.121604 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e509a440-ce25-4a05-9a78-4413d5b98281 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007797 Jul 26 12:51:14.128531 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Jul 26 12:51:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 12:51:14.133929 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ceaa5ef3-a6f5-4405-a9a6-37f09e44d519 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Calling method '.version_select at 0x7f65f717e700>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:14.262388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-fe883c2d-5fac-4d14-98a9-384930a67499 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] Calling method '.version_select at 0x7f65f796d280>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:14.330008 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-fe883c2d-5fac-4d14-98a9-384930a67499 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/267e97fa-53ec-4351-99e3-feb250711e41" status: 200 len: 350 microversion: 2.1 time: 0.071814 Jul 26 12:51:14.331109 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 12:51:14 2022] GET /compute/v2.1/os-volumes/267e97fa-53ec-4351-99e3-feb250711e41 => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:51:14.431102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-ceaa5ef3-a6f5-4405-a9a6-37f09e44d519 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] HTTP exception thrown: Volume ac9e6ec3-2bc0-4d99-9a2a-3fd8e794bdd6 could not be found. Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ceaa5ef3-a6f5-4405-a9a6-37f09e44d519 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Request method failure captured: Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: DELETE /compute/v2.1/os-volumes/ac9e6ec3-2bc0-4d99-9a2a-3fd8e794bdd6 HTTP/1.1 Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-M-6-7bQJHN3nn3yabyTcZebqOos3j2X_J9_85QhSQtq4RSRlPvUMFCbwLWX98jAd9XA9g6Y5YCH1riSWlz29e-mjKzoe6bFf9m6cO9P-c5HwGy3g0Qmkl4Y6rlyvVOptyyDSqrLEhKbyZGuelMWHlxnFAaEO6foPTYOMyYaOnn6bA Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: f70a0bbf5d2b49e99566672e689657ba Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:51:14.435001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:51:14.436619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f70a0bbf5d2b49e99566672e689657ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f70a0bbf5d2b49e99566672e689657ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f70a0bbf5d2b49e99566672e689657ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f70a0bbf5d2b49e99566672e689657ba"}]}] Jul 26 12:51:14.436619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:14.436619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: f70a0bbf5d2b49e99566672e689657ba Jul 26 12:51:14.436619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:14.436619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-VolumesNegativeTest-562612364-project Jul 26 12:51:14.436619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:51:14.436619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:51:14.436619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: b515c2b9f1e94764ab6c3a6ddeaeb5c1 Jul 26 12:51:14.436619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-VolumesNegativeTest-562612364-project Jul 26 12:51:14.436619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: Jul 26 12:51:14.436619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Volume ac9e6ec3-2bc0-4d99-9a2a-3fd8e794bdd6 could not be found. Jul 26 12:51:14.436619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': 'ac9e6ec3-2bc0-4d99-9a2a-3fd8e794bdd6'} Jul 26 12:51:14.436619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ac9e6ec3-2bc0-4d99-9a2a-3fd8e794bdd6 could not be found. (HTTP 404) (Request-ID: req-556231d1-76c8-419c-be1b-e492ba1556f8) Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:14.437896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 12:51:14.439241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ac9e6ec3-2bc0-4d99-9a2a-3fd8e794bdd6 could not be found. Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 12:51:14.440519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ac9e6ec3-2bc0-4d99-9a2a-3fd8e794bdd6 could not be found. Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ac9e6ec3-2bc0-4d99-9a2a-3fd8e794bdd6 could not be found. Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ceaa5ef3-a6f5-4405-a9a6-37f09e44d519 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Returning 404 to user: Volume ac9e6ec3-2bc0-4d99-9a2a-3fd8e794bdd6 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ceaa5ef3-a6f5-4405-a9a6-37f09e44d519 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/ac9e6ec3-2bc0-4d99-9a2a-3fd8e794bdd6" status: 404 len: 109 microversion: 2.1 time: 0.307284 Jul 26 12:51:14.441924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Jul 26 12:51:14 2022] DELETE /compute/v2.1/os-volumes/ac9e6ec3-2bc0-4d99-9a2a-3fd8e794bdd6 => generated 109 bytes in 309 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:51:14.446046 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b933fd1c-fefd-47bb-be2b-97c40349a9f8 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Calling method '.version_select at 0x7f65f70a2430>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:14.624465 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-b933fd1c-fefd-47bb-be2b-97c40349a9f8 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] HTTP exception thrown: Volume 4473aead-7a29-476b-924e-52670996e253 could not be found. Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b933fd1c-fefd-47bb-be2b-97c40349a9f8 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Request method failure captured: Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/os-volumes/4473aead-7a29-476b-924e-52670996e253 HTTP/1.1 Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-M-6-7bQJHN3nn3yabyTcZebqOos3j2X_J9_85QhSQtq4RSRlPvUMFCbwLWX98jAd9XA9g6Y5YCH1riSWlz29e-mjKzoe6bFf9m6cO9P-c5HwGy3g0Qmkl4Y6rlyvVOptyyDSqrLEhKbyZGuelMWHlxnFAaEO6foPTYOMyYaOnn6bA Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: f70a0bbf5d2b49e99566672e689657ba Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:51:14.626635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:51:14.628043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f70a0bbf5d2b49e99566672e689657ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f70a0bbf5d2b49e99566672e689657ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f70a0bbf5d2b49e99566672e689657ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f70a0bbf5d2b49e99566672e689657ba"}]}] Jul 26 12:51:14.628043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:14.628043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: f70a0bbf5d2b49e99566672e689657ba Jul 26 12:51:14.628043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-VolumesNegativeTest-562612364 Jul 26 12:51:14.628043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-VolumesNegativeTest-562612364-project Jul 26 12:51:14.628043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:51:14.628043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:51:14.628043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: b515c2b9f1e94764ab6c3a6ddeaeb5c1 Jul 26 12:51:14.628043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-VolumesNegativeTest-562612364-project Jul 26 12:51:14.628043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: Jul 26 12:51:14.628043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Volume 4473aead-7a29-476b-924e-52670996e253 could not be found. Jul 26 12:51:14.628043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '4473aead-7a29-476b-924e-52670996e253'} Jul 26 12:51:14.628043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4473aead-7a29-476b-924e-52670996e253 could not be found. (HTTP 404) (Request-ID: req-ef8fb290-c528-42cf-aa52-553617c6dda7) Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:14.629365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 12:51:14.630740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4473aead-7a29-476b-924e-52670996e253 could not be found. Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 12:51:14.634453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4473aead-7a29-476b-924e-52670996e253 could not be found. Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4473aead-7a29-476b-924e-52670996e253 could not be found. Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b933fd1c-fefd-47bb-be2b-97c40349a9f8 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] Returning 404 to user: Volume 4473aead-7a29-476b-924e-52670996e253 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b933fd1c-fefd-47bb-be2b-97c40349a9f8 tempest-VolumesNegativeTest-562612364 tempest-VolumesNegativeTest-562612364-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/4473aead-7a29-476b-924e-52670996e253" status: 404 len: 109 microversion: 2.1 time: 0.185849 Jul 26 12:51:14.638069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 12:51:14 2022] GET /compute/v2.1/os-volumes/4473aead-7a29-476b-924e-52670996e253 => generated 109 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:51:16.263293 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-199d790f-dcd8-4ef7-80cb-d37eb42d0c42 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] Calling method '.version_select at 0x7f65f70b1310>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:16.353994 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-199d790f-dcd8-4ef7-80cb-d37eb42d0c42 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/9a3ccc13-3ab6-4dcc-9dfb-21c73d74b3e3" status: 200 len: 350 microversion: 2.1 time: 0.095464 Jul 26 12:51:16.354985 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 12:51:16 2022] GET /compute/v2.1/os-volumes/9a3ccc13-3ab6-4dcc-9dfb-21c73d74b3e3 => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:51:23.517301 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0a1207c8-b9df-404c-9431-bacf1db35608 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] Calling method '.version_select at 0x7f65f70b1160>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:23.634966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0a1207c8-b9df-404c-9431-bacf1db35608 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/11d91a44-0375-4105-a195-4209538e5c6a" status: 200 len: 351 microversion: 2.1 time: 0.122870 Jul 26 12:51:23.635933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 12:51:23 2022] GET /compute/v2.1/os-volumes/11d91a44-0375-4105-a195-4209538e5c6a => generated 351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:51:23.650448 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-523380ea-fa22-47dc-9cc6-597f927a9b45 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] Calling method '.version_select at 0x7f65f70b1a60>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:23.921931 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-523380ea-fa22-47dc-9cc6-597f927a9b45 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.277186 Jul 26 12:51:23.931697 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Jul 26 12:51:23 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:23.937877 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-231bbc0b-2dc9-4c07-95c4-948572544319 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] Calling method '.version_select at 0x7f65f70a2940>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:24.139736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-231bbc0b-2dc9-4c07-95c4-948572544319 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.206603 Jul 26 12:51:24.140226 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Jul 26 12:51:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:51:24.155861 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8774bf77-cd00-4c89-b5af-f7605b585e8f tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] Calling method '.version_select at 0x7f65f70b14c0>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:24.234332 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1718930841", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:24.387471 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8774bf77-cd00-4c89-b5af-f7605b585e8f tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.236590 Jul 26 12:51:24.388436 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Jul 26 12:51:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:24.401211 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-06e8ee8e-e34f-4fc6-9b1e-bf4bf23a009f tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] Calling method '.version_select at 0x7f65f70b2310>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:24.533065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.network.neutron [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] validate_networks() for [('399a1d18-4e78-4e8a-8ddb-7b454af2918b', None, None, None, None, None)] {{(pid=129307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:51:24.677743 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-06e8ee8e-e34f-4fc6-9b1e-bf4bf23a009f tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.280429 Jul 26 12:51:24.678296 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 9/15] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Jul 26 12:51:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:51:24.692395 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f0e28575-72c9-407c-af22-21c62dd61e0b tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] Calling method '.version_select at 0x7f65f70a2160>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:24.944786 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f0e28575-72c9-407c-af22-21c62dd61e0b tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.256955 Jul 26 12:51:24.945348 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 10/16] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Jul 26 12:51:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:51:24.963178 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-35ea5a5e-983c-4673-b899-0f359b3f8495 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] Calling method '.version_select at 0x7f65f70b15e0>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:25.294732 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-35ea5a5e-983c-4673-b899-0f359b3f8495 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.337627 Jul 26 12:51:25.296468 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 11/17] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Jul 26 12:51:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:25.344944 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-bf11209a-7d25-46a5-8da0-745175f380d6 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] Calling method '.version_select at 0x7f65f70b40d0>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:25.596645 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-bf11209a-7d25-46a5-8da0-745175f380d6 tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.285131 Jul 26 12:51:25.597782 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 12/18] 10.222.0.20 () {58 vars in 1188 bytes} [Tue Jul 26 12:51:25 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:51:25.610928 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-61716444-6731-4c9b-a977-ef22d87d867e tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] Calling method '.version_select at 0x7f65f70b1700>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:25.868708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-61716444-6731-4c9b-a977-ef22d87d867e tempest-VolumesTestJSON-1116624060 tempest-VolumesTestJSON-1116624060-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.261468 Jul 26 12:51:25.870454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 13/19] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Jul 26 12:51:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:51:27.691672 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Flavor limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:51:27.691672 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Image limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:51:27.691672 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Flavor pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:51:27.691672 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Image pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:51:27.691672 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:51:27.732163 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:27.734438 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:27.738268 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:27.743076 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:27.868633 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Getting quotas for project d92bfe73c0a54823a88a89f9ae627134. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:51:27.885247 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Getting quotas for user 2b5894762d4b4cc99521bc224d2bddd7 and project d92bfe73c0a54823a88a89f9ae627134. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:51:27.914122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Going to run 1 instances... {{(pid=129307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:51:27.917650 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:51:27.962890 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f43f9bf8-874a-43a3-9bad-0ff1c700951c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Action: 'create', calling method: .version_select at 0x7f65f70a2430>, body: {"keypair": {"name": "tempest-keypair-1559423665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChk9+uSxmfZim2g4I8Hkz7p/o6VfV1IGLN8WGKdZ+UMhmWi4/PkYZSPPRlmn3wkUwL0Z3zGTvkPb+7hL9ACGVCV2NXb5VADj7OvFkdaoMxY/2kV1EP/gt5rOOnFADJ/rQ=="}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:28.044642 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-f43f9bf8-874a-43a3-9bad-0ff1c700951c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for project 01fca015df86428b9356df3f127327c2. Resources: {'key_pairs'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:51:28.051493 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-f43f9bf8-874a-43a3-9bad-0ff1c700951c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for user 1401efb776ab424e8ff4f09eac33d92f and project 01fca015df86428b9356df3f127327c2. Resources: {'key_pairs'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:51:28.060044 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-951dd3d1-9e66-4bdb-a95b-e97f526ca3e2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.113545 Jul 26 12:51:28.060892 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 7/20] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:51:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 4115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 12:51:28.188051 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-da15cb7c-5b20-4292-bf86-d505df343bc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Action: 'create', calling method: .version_select at 0x7f65f67a8af0>, body: {"keypair": {"name": "tempest-keypair-1176248174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7LV3gDacng2juVgHPsYlZCSk+vaTg26128nHvN2gB8sFNr9Di/r6/uuLkuZLXKk4d+pucD1stLSVLk937JAmpKLl5nin5QdbTu+uKLL2n+JZIDqkGgvR71TVQ+q5nPig=="}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:28.200568 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f43f9bf8-874a-43a3-9bad-0ff1c700951c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.399266 Jul 26 12:51:28.203755 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 14/21] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Jul 26 12:51:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:51:28.226486 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-da15cb7c-5b20-4292-bf86-d505df343bc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Getting quotas for project a93dd858fb7a40fbbb679fbe676b1f3c. Resources: {'key_pairs'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:51:28.238109 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-16d7fbd0-1765-4906-92eb-dbfb9cce6dc4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:28.239150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-da15cb7c-5b20-4292-bf86-d505df343bc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Getting quotas for user 17b7e2c1b1b04366b99e9ab892aeb835 and project a93dd858fb7a40fbbb679fbe676b1f3c. Resources: {'key_pairs'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:51:28.242180 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-16d7fbd0-1765-4906-92eb-dbfb9cce6dc4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:28.344472 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-da15cb7c-5b20-4292-bf86-d505df343bc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.281164 Jul 26 12:51:28.346395 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 8/22] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Jul 26 12:51:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 285 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 12:51:28.452521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-16d7fbd0-1765-4906-92eb-dbfb9cce6dc4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:28.483476 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-16d7fbd0-1765-4906-92eb-dbfb9cce6dc4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1222 microversion: 2.1 time: 0.272217 Jul 26 12:51:28.485886 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 15/23] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:28 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1222 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:28.683884 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-348123802", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:28.802764 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.network.neutron [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] validate_networks() for [('399a1d18-4e78-4e8a-8ddb-7b454af2918b', None, None, None, None, None)] {{(pid=129307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:51:29.709406 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1492593787", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "networks": [{"uuid": "6fabf242-8047-497f-a6fd-86506ce455c6"}]}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:29.874719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.network.neutron [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] validate_networks() for [('6fabf242-8047-497f-a6fd-86506ce455c6', None, None, None, None, None)] {{(pid=129308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:51:30.637671 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Flavor limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:51:30.638242 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Image limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:51:30.638592 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Flavor pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:51:30.639430 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Image pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:51:30.639886 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:51:30.686776 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:30.687243 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:30.693434 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:30.697970 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:30.766283 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Getting quotas for project d92bfe73c0a54823a88a89f9ae627134. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:51:30.771997 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Getting quotas for user 2b5894762d4b4cc99521bc224d2bddd7 and project d92bfe73c0a54823a88a89f9ae627134. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:51:30.805258 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Going to run 1 instances... {{(pid=129307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:51:30.809034 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:51:30.945095 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4734c85f-a3a2-4372-a5db-fa0b364b83cc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.265805 Jul 26 12:51:30.946458 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 9/24] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:51:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 12:51:30.960829 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-dec31fe1-fca0-4e21-b6df-53fa3fecffda tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:30.964338 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-dec31fe1-fca0-4e21-b6df-53fa3fecffda tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:31.248585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-dec31fe1-fca0-4e21-b6df-53fa3fecffda tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:31.281305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-dec31fe1-fca0-4e21-b6df-53fa3fecffda tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1221 microversion: 2.1 time: 0.327127 Jul 26 12:51:31.292586 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 10/25] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:30 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1221 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:31.743109 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Flavor limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:51:31.743665 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Image limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:51:31.744608 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Flavor pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:51:31.745009 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Image pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:51:31.745487 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:51:31.785669 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:31.787786 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:31.794109 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:31.797286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:31.870558 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Getting quotas for project 0f35a4b7696f4cdfbb6e6b316352c022. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:51:31.876395 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Getting quotas for user 7c4ed2f2f6994ae2bb00d5a502715b4f and project 0f35a4b7696f4cdfbb6e6b316352c022. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:51:31.895534 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Going to run 1 instances... {{(pid=129308) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:51:31.898449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:51:32.088419 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-5a1a4014-da8d-4ff2-9c64-aa2ba3f0d0dc tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.481902 Jul 26 12:51:32.097458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 16/26] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:51:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 12:51:32.108704 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d74287ff-fae6-4e3f-8f66-29e1fb87eb14 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:32.109806 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d74287ff-fae6-4e3f-8f66-29e1fb87eb14 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:32.170274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2021343667", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "923d9432-be57-465d-9c21-1d0c5b4c37d3"}], "security_groups": [{"name": "tempest-securitygroup--1783988982"}], "key_name": "tempest-keypair-1559423665", "user_data": "}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:32.226711 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d74287ff-fae6-4e3f-8f66-29e1fb87eb14 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:32.236523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d74287ff-fae6-4e3f-8f66-29e1fb87eb14 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1215 microversion: 2.1 time: 0.138813 Jul 26 12:51:32.237429 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 11/27] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:32 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:32.309967 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-7b586ba0-6cbf-429d-95ea-33d4a291f212 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:32.315577 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-7b586ba0-6cbf-429d-95ea-33d4a291f212 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:32.417932 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-7b586ba0-6cbf-429d-95ea-33d4a291f212 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:32.437777 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-7b586ba0-6cbf-429d-95ea-33d4a291f212 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1221 microversion: 2.1 time: 0.136916 Jul 26 12:51:32.438404 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 12/28] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:32 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1221 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:32.535807 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.network.neutron [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] validate_networks() for [('923d9432-be57-465d-9c21-1d0c5b4c37d3', None, None, None, None, None)] {{(pid=129308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:51:33.258448 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-59ae3e16-5d8b-4b40-94de-1ed9e1ed8c8d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:33.259524 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-59ae3e16-5d8b-4b40-94de-1ed9e1ed8c8d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:33.266430 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-59ae3e16-5d8b-4b40-94de-1ed9e1ed8c8d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:33.266876 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-59ae3e16-5d8b-4b40-94de-1ed9e1ed8c8d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:33.267678 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-59ae3e16-5d8b-4b40-94de-1ed9e1ed8c8d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:33.280764 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-59ae3e16-5d8b-4b40-94de-1ed9e1ed8c8d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:33.513028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-59ae3e16-5d8b-4b40-94de-1ed9e1ed8c8d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:33.537209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-59ae3e16-5d8b-4b40-94de-1ed9e1ed8c8d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1219 microversion: 2.1 time: 0.281623 Jul 26 12:51:33.539367 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 13/29] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:33 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1219 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:33.559226 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1686930538", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a8231d6-efdb-4b1f-9ae4-a493641a47ab"}], "security_groups": [{"name": "tempest-securitygroup--295277614"}], "key_name": "tempest-keypair-1176248174", "user_data": "}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:33.676383 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Flavor limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:51:33.678504 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Image limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:51:33.679366 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Flavor pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:51:33.680289 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Image pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:51:33.680976 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:51:33.693288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:33.693743 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:33.695199 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:33.695803 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:33.758838 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for project 01fca015df86428b9356df3f127327c2. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:51:33.774537 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for user 1401efb776ab424e8ff4f09eac33d92f and project 01fca015df86428b9356df3f127327c2. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:51:33.790842 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Going to run 1 instances... {{(pid=129308) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:51:33.794274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:51:33.834547 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.network.neutron [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] validate_networks() for [('2a8231d6-efdb-4b1f-9ae4-a493641a47ab', None, None, None, None, None)] {{(pid=129307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:51:33.965913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0e25ed7f-88aa-4d01-9d49-6237e7930e18 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.804439 Jul 26 12:51:33.968730 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 17/30] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:51:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 12:51:33.981797 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e88599f6-a6ff-4c8b-89c3-716f7b074785 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:33.982596 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e88599f6-a6ff-4c8b-89c3-716f7b074785 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:34.014308 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e88599f6-a6ff-4c8b-89c3-716f7b074785 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:34.019982 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e88599f6-a6ff-4c8b-89c3-716f7b074785 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:34.021018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e88599f6-a6ff-4c8b-89c3-716f7b074785 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:34.021680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e88599f6-a6ff-4c8b-89c3-716f7b074785 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:34.494696 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e88599f6-a6ff-4c8b-89c3-716f7b074785 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:34.541317 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e88599f6-a6ff-4c8b-89c3-716f7b074785 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1273 microversion: 2.1 time: 0.571389 Jul 26 12:51:34.552632 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 18/31] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:33 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1273 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:34.568600 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-69b23b5a-57ed-4e28-816d-0a7a5a239f40 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:34.587986 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-69b23b5a-57ed-4e28-816d-0a7a5a239f40 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:34.821068 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-69b23b5a-57ed-4e28-816d-0a7a5a239f40 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:34.848053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-69b23b5a-57ed-4e28-816d-0a7a5a239f40 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1242 microversion: 2.1 time: 0.287852 Jul 26 12:51:34.848703 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 19/32] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:34 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1242 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:34.868431 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-01c8ca4b-1e52-49a8-a920-67f5db187f76 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:34.872901 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-01c8ca4b-1e52-49a8-a920-67f5db187f76 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:34.900162 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-01c8ca4b-1e52-49a8-a920-67f5db187f76 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:34.900629 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-01c8ca4b-1e52-49a8-a920-67f5db187f76 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:34.901428 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-01c8ca4b-1e52-49a8-a920-67f5db187f76 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:34.901874 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-01c8ca4b-1e52-49a8-a920-67f5db187f76 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:35.154960 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-01c8ca4b-1e52-49a8-a920-67f5db187f76 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:35.168965 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-01c8ca4b-1e52-49a8-a920-67f5db187f76 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1267 microversion: 2.1 time: 0.316774 Jul 26 12:51:35.169555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 20/33] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:34 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:35.576203 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-503413d2-ab18-4590-970c-34947879eb6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:35.577351 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-503413d2-ab18-4590-970c-34947879eb6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:35.600253 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-503413d2-ab18-4590-970c-34947879eb6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:35.601050 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-503413d2-ab18-4590-970c-34947879eb6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:35.603826 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-503413d2-ab18-4590-970c-34947879eb6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:35.606577 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-503413d2-ab18-4590-970c-34947879eb6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:35.759784 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Flavor limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:51:35.760859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Image limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:51:35.761544 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Flavor pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:51:35.762164 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Image pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:51:35.762771 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:51:35.783810 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:35.784278 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:35.785099 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:35.802684 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:35.882338 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Getting quotas for project a93dd858fb7a40fbbb679fbe676b1f3c. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:51:35.908195 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Getting quotas for user 17b7e2c1b1b04366b99e9ab892aeb835 and project a93dd858fb7a40fbbb679fbe676b1f3c. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:51:35.950923 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Going to run 1 instances... {{(pid=129307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:51:35.955027 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:51:35.969635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-503413d2-ab18-4590-970c-34947879eb6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:35.981450 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-503413d2-ab18-4590-970c-34947879eb6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1279 microversion: 2.1 time: 0.411019 Jul 26 12:51:35.982214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 21/34] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:35 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1279 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:51:35.989919 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0464416e-c351-45ac-a2e7-4cabe13f6b32 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:35.996483 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0464416e-c351-45ac-a2e7-4cabe13f6b32 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:36.019941 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0464416e-c351-45ac-a2e7-4cabe13f6b32 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:36.020500 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0464416e-c351-45ac-a2e7-4cabe13f6b32 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:36.028110 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0464416e-c351-45ac-a2e7-4cabe13f6b32 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:36.028635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0464416e-c351-45ac-a2e7-4cabe13f6b32 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:36.064341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-babb04d1-e40e-4be0-a81c-e9aec0362e96 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.522454 Jul 26 12:51:36.070137 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 14/35] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Jul 26 12:51:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 2530 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 12:51:36.077633 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e7b7c2c1-0012-4ba6-8211-4aa6ad3524fd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:36.078030 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e7b7c2c1-0012-4ba6-8211-4aa6ad3524fd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:36.380413 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e7b7c2c1-0012-4ba6-8211-4aa6ad3524fd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:36.411949 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e7b7c2c1-0012-4ba6-8211-4aa6ad3524fd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:36.425037 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e7b7c2c1-0012-4ba6-8211-4aa6ad3524fd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:36.428729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e7b7c2c1-0012-4ba6-8211-4aa6ad3524fd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1282 microversion: 2.20 time: 0.355035 Jul 26 12:51:36.452473 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 15/36] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:36 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1282 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:51:36.479751 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-49e8df3e-729b-4c8d-9e94-161cd1a69ae2 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:36.482086 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-49e8df3e-729b-4c8d-9e94-161cd1a69ae2 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:36.500264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-49e8df3e-729b-4c8d-9e94-161cd1a69ae2 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:36.501973 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-49e8df3e-729b-4c8d-9e94-161cd1a69ae2 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:36.505963 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-49e8df3e-729b-4c8d-9e94-161cd1a69ae2 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:36.506816 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-49e8df3e-729b-4c8d-9e94-161cd1a69ae2 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:36.691870 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0464416e-c351-45ac-a2e7-4cabe13f6b32 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:36.707103 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0464416e-c351-45ac-a2e7-4cabe13f6b32 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1294 microversion: 2.1 time: 0.723412 Jul 26 12:51:36.720652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 22/37] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:35 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1294 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:36.960619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-49e8df3e-729b-4c8d-9e94-161cd1a69ae2 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:36.984761 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-49e8df3e-729b-4c8d-9e94-161cd1a69ae2 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1273 microversion: 2.1 time: 0.528508 Jul 26 12:51:37.006977 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-510bbda3-d10c-4cfb-94c5-577e8e00af0f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:37.007614 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-510bbda3-d10c-4cfb-94c5-577e8e00af0f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:37.014691 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 16/38] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:36 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1273 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:37.017300 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-510bbda3-d10c-4cfb-94c5-577e8e00af0f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:37.024143 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-510bbda3-d10c-4cfb-94c5-577e8e00af0f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:37.025231 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-510bbda3-d10c-4cfb-94c5-577e8e00af0f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:37.025946 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-510bbda3-d10c-4cfb-94c5-577e8e00af0f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:37.287517 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-510bbda3-d10c-4cfb-94c5-577e8e00af0f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:37.304123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-510bbda3-d10c-4cfb-94c5-577e8e00af0f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1279 microversion: 2.1 time: 0.303813 Jul 26 12:51:37.305321 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 23/39] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:36 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1279 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:37.463391 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-bc486b8d-c490-4623-9c0e-19f3b9c3c300 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:37.464603 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-bc486b8d-c490-4623-9c0e-19f3b9c3c300 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:37.478288 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bc486b8d-c490-4623-9c0e-19f3b9c3c300 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:37.487819 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bc486b8d-c490-4623-9c0e-19f3b9c3c300 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:37.489193 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bc486b8d-c490-4623-9c0e-19f3b9c3c300 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:37.490726 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bc486b8d-c490-4623-9c0e-19f3b9c3c300 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:37.707993 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bc486b8d-c490-4623-9c0e-19f3b9c3c300 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:37.743059 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f8bbaa91-0d99-4c47-80a4-46759739e8ca tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:37.743968 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f8bbaa91-0d99-4c47-80a4-46759739e8ca tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:37.749841 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bc486b8d-c490-4623-9c0e-19f3b9c3c300 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:37.751981 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bc486b8d-c490-4623-9c0e-19f3b9c3c300 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:37.758188 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-bc486b8d-c490-4623-9c0e-19f3b9c3c300 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1286 microversion: 2.20 time: 0.299616 Jul 26 12:51:37.759319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8bbaa91-0d99-4c47-80a4-46759739e8ca tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:37.760785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8bbaa91-0d99-4c47-80a4-46759739e8ca tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:37.780317 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 17/40] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:37 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1286 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:51:37.780698 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8bbaa91-0d99-4c47-80a4-46759739e8ca tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:37.781168 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8bbaa91-0d99-4c47-80a4-46759739e8ca tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:38.011694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-131589ed-31c1-4683-b0e5-598e622ef94a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:38.012295 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-131589ed-31c1-4683-b0e5-598e622ef94a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:38.025519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-131589ed-31c1-4683-b0e5-598e622ef94a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:38.025993 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-131589ed-31c1-4683-b0e5-598e622ef94a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:38.026777 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-131589ed-31c1-4683-b0e5-598e622ef94a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:38.031756 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-131589ed-31c1-4683-b0e5-598e622ef94a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:38.120343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f8bbaa91-0d99-4c47-80a4-46759739e8ca tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:38.132751 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f8bbaa91-0d99-4c47-80a4-46759739e8ca tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1300 microversion: 2.1 time: 0.394432 Jul 26 12:51:38.133344 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 24/41] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:37 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1300 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:51:38.144144 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-131589ed-31c1-4683-b0e5-598e622ef94a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:38.154064 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-131589ed-31c1-4683-b0e5-598e622ef94a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1273 microversion: 2.1 time: 0.147158 Jul 26 12:51:38.155032 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 18/42] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:38 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:38.325985 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9ab2f992-8ca3-41f3-be3d-731ffc874d96 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:38.326942 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-9ab2f992-8ca3-41f3-be3d-731ffc874d96 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:38.335486 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9ab2f992-8ca3-41f3-be3d-731ffc874d96 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:38.336123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9ab2f992-8ca3-41f3-be3d-731ffc874d96 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:38.336991 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9ab2f992-8ca3-41f3-be3d-731ffc874d96 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:38.337545 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9ab2f992-8ca3-41f3-be3d-731ffc874d96 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:38.792561 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-da6d95c8-53b5-49ac-817d-96f8f3693efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:38.793979 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-da6d95c8-53b5-49ac-817d-96f8f3693efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:38.803615 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-da6d95c8-53b5-49ac-817d-96f8f3693efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:38.804502 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-da6d95c8-53b5-49ac-817d-96f8f3693efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:38.805482 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-da6d95c8-53b5-49ac-817d-96f8f3693efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:38.806185 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-da6d95c8-53b5-49ac-817d-96f8f3693efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:38.905127 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-da6d95c8-53b5-49ac-817d-96f8f3693efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:38.924920 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-da6d95c8-53b5-49ac-817d-96f8f3693efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:38.929128 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-da6d95c8-53b5-49ac-817d-96f8f3693efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:38.933796 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-da6d95c8-53b5-49ac-817d-96f8f3693efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1286 microversion: 2.20 time: 0.149230 Jul 26 12:51:38.948134 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-9ab2f992-8ca3-41f3-be3d-731ffc874d96 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:38.949191 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 19/43] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:38 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:51:38.956335 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9ab2f992-8ca3-41f3-be3d-731ffc874d96 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.634410 Jul 26 12:51:38.956913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 25/44] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:38 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:39.155281 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-20cf6465-da17-4352-acf9-3740726cba78 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:39.156471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-20cf6465-da17-4352-acf9-3740726cba78 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:39.184038 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8248e150-51ff-491a-8c9e-03948cea0e03 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:39.184638 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8248e150-51ff-491a-8c9e-03948cea0e03 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:39.221059 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20cf6465-da17-4352-acf9-3740726cba78 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:39.221583 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20cf6465-da17-4352-acf9-3740726cba78 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:39.222401 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20cf6465-da17-4352-acf9-3740726cba78 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:39.222840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20cf6465-da17-4352-acf9-3740726cba78 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:39.227980 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8248e150-51ff-491a-8c9e-03948cea0e03 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:39.228580 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8248e150-51ff-491a-8c9e-03948cea0e03 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:39.229412 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8248e150-51ff-491a-8c9e-03948cea0e03 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:39.229850 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8248e150-51ff-491a-8c9e-03948cea0e03 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:39.458097 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-20cf6465-da17-4352-acf9-3740726cba78 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:39.469215 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-20cf6465-da17-4352-acf9-3740726cba78 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1300 microversion: 2.1 time: 0.318500 Jul 26 12:51:39.479836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 20/45] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:39 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1300 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:39.665594 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8248e150-51ff-491a-8c9e-03948cea0e03 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:39.676732 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8248e150-51ff-491a-8c9e-03948cea0e03 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.504868 Jul 26 12:51:39.678166 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 26/46] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:39 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:51:39.961073 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e91cb93a-4453-44e5-9a04-4abd85ac79cd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:39.962457 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e91cb93a-4453-44e5-9a04-4abd85ac79cd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:39.978716 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-4043ca9e-4b74-4e01-8619-e08dce99931a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:39.979547 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-4043ca9e-4b74-4e01-8619-e08dce99931a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:39.992136 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e91cb93a-4453-44e5-9a04-4abd85ac79cd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:39.992797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e91cb93a-4453-44e5-9a04-4abd85ac79cd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:39.994994 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e91cb93a-4453-44e5-9a04-4abd85ac79cd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:39.995687 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4043ca9e-4b74-4e01-8619-e08dce99931a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:39.996724 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4043ca9e-4b74-4e01-8619-e08dce99931a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:39.998433 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e91cb93a-4453-44e5-9a04-4abd85ac79cd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:40.002922 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4043ca9e-4b74-4e01-8619-e08dce99931a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:40.004634 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4043ca9e-4b74-4e01-8619-e08dce99931a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:40.086530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e91cb93a-4453-44e5-9a04-4abd85ac79cd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:40.100139 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e91cb93a-4453-44e5-9a04-4abd85ac79cd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:40.102452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e91cb93a-4453-44e5-9a04-4abd85ac79cd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:40.104264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e91cb93a-4453-44e5-9a04-4abd85ac79cd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1286 microversion: 2.20 time: 0.147933 Jul 26 12:51:40.120513 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 21/47] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:39 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:51:40.501321 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-7c1dde6d-e256-47a0-81cc-46fe1e1b9962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:40.502718 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-7c1dde6d-e256-47a0-81cc-46fe1e1b9962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:40.519502 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7c1dde6d-e256-47a0-81cc-46fe1e1b9962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:40.523095 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7c1dde6d-e256-47a0-81cc-46fe1e1b9962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:40.525718 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7c1dde6d-e256-47a0-81cc-46fe1e1b9962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:40.527412 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7c1dde6d-e256-47a0-81cc-46fe1e1b9962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:40.566914 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-4043ca9e-4b74-4e01-8619-e08dce99931a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:40.582829 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-4043ca9e-4b74-4e01-8619-e08dce99931a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.603853 Jul 26 12:51:40.585559 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 27/48] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:39 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:51:40.675781 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-7c1dde6d-e256-47a0-81cc-46fe1e1b9962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:40.685757 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-7c1dde6d-e256-47a0-81cc-46fe1e1b9962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1300 microversion: 2.1 time: 0.193196 Jul 26 12:51:40.697557 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a9e3c0f2-6ded-421f-86d1-d8498c414274 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:40.698537 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-a9e3c0f2-6ded-421f-86d1-d8498c414274 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:40.703363 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 22/49] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:40 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1300 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:51:40.712767 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a9e3c0f2-6ded-421f-86d1-d8498c414274 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:40.713925 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a9e3c0f2-6ded-421f-86d1-d8498c414274 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:40.716552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a9e3c0f2-6ded-421f-86d1-d8498c414274 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:40.721167 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a9e3c0f2-6ded-421f-86d1-d8498c414274 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:41.137510 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9e317ffd-e0fb-4fd0-ad02-2c2fcef97435 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:41.138536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9e317ffd-e0fb-4fd0-ad02-2c2fcef97435 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:41.159533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9e317ffd-e0fb-4fd0-ad02-2c2fcef97435 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:41.161589 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9e317ffd-e0fb-4fd0-ad02-2c2fcef97435 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:41.163956 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9e317ffd-e0fb-4fd0-ad02-2c2fcef97435 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:41.203421 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9e317ffd-e0fb-4fd0-ad02-2c2fcef97435 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:41.562401 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9e317ffd-e0fb-4fd0-ad02-2c2fcef97435 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:41.585486 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9e317ffd-e0fb-4fd0-ad02-2c2fcef97435 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:41.614202 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9e317ffd-e0fb-4fd0-ad02-2c2fcef97435 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:41.623996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9e317ffd-e0fb-4fd0-ad02-2c2fcef97435 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1334 microversion: 2.20 time: 0.489523 Jul 26 12:51:41.628198 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 23/50] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:41 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1334 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:51:41.651238 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ce9311dc-300c-47ba-9a60-b56057715d6b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:41.656488 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ce9311dc-300c-47ba-9a60-b56057715d6b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:41.685198 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ce9311dc-300c-47ba-9a60-b56057715d6b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:41.687045 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ce9311dc-300c-47ba-9a60-b56057715d6b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:41.689787 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ce9311dc-300c-47ba-9a60-b56057715d6b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:41.694449 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ce9311dc-300c-47ba-9a60-b56057715d6b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:41.734096 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-a9e3c0f2-6ded-421f-86d1-d8498c414274 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:41.741929 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a9e3c0f2-6ded-421f-86d1-d8498c414274 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 1.048298 Jul 26 12:51:41.761181 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 28/51] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:40 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:41.761181 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d1da6f3d-f211-454d-8ce8-f1a282501bcf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:41.761181 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d1da6f3d-f211-454d-8ce8-f1a282501bcf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:41.780697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d1da6f3d-f211-454d-8ce8-f1a282501bcf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:41.786880 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d1da6f3d-f211-454d-8ce8-f1a282501bcf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:41.790681 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d1da6f3d-f211-454d-8ce8-f1a282501bcf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:41.791401 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d1da6f3d-f211-454d-8ce8-f1a282501bcf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:42.343852 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d1da6f3d-f211-454d-8ce8-f1a282501bcf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:42.352903 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d1da6f3d-f211-454d-8ce8-f1a282501bcf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1300 microversion: 2.1 time: 0.598872 Jul 26 12:51:42.362571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 29/52] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:41 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1300 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:42.653492 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7d7e2566-96b6-4d31-9d7d-f038cca16875 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:42.654438 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7d7e2566-96b6-4d31-9d7d-f038cca16875 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:42.673309 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d7e2566-96b6-4d31-9d7d-f038cca16875 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:42.674811 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d7e2566-96b6-4d31-9d7d-f038cca16875 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:42.676060 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d7e2566-96b6-4d31-9d7d-f038cca16875 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:42.676740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d7e2566-96b6-4d31-9d7d-f038cca16875 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:43.020741 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ce9311dc-300c-47ba-9a60-b56057715d6b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:43.038136 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ce9311dc-300c-47ba-9a60-b56057715d6b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 1.402181 Jul 26 12:51:43.038995 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 24/53] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:41 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:43.064844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8f20acd8-155d-45e0-985d-c22385156254 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:43.066517 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8f20acd8-155d-45e0-985d-c22385156254 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:43.073783 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:43.102221 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8f20acd8-155d-45e0-985d-c22385156254 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:43.102942 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8f20acd8-155d-45e0-985d-c22385156254 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:43.104673 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8f20acd8-155d-45e0-985d-c22385156254 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:43.107244 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8f20acd8-155d-45e0-985d-c22385156254 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:43.296981 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7d7e2566-96b6-4d31-9d7d-f038cca16875 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:43.311175 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7d7e2566-96b6-4d31-9d7d-f038cca16875 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:43.317763 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7d7e2566-96b6-4d31-9d7d-f038cca16875 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:43.319370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7d7e2566-96b6-4d31-9d7d-f038cca16875 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1340 microversion: 2.20 time: 0.670122 Jul 26 12:51:43.321709 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 30/54] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:42 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1340 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:51:43.393687 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-89668e12-173f-4d2b-bc4e-dfdfab9a0b19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:43.394504 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-89668e12-173f-4d2b-bc4e-dfdfab9a0b19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:43.411013 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-89668e12-173f-4d2b-bc4e-dfdfab9a0b19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:43.411922 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-89668e12-173f-4d2b-bc4e-dfdfab9a0b19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:43.413455 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-89668e12-173f-4d2b-bc4e-dfdfab9a0b19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:43.414047 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-89668e12-173f-4d2b-bc4e-dfdfab9a0b19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:43.712376 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8f20acd8-155d-45e0-985d-c22385156254 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:43.715353 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=4 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:43.723837 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8f20acd8-155d-45e0-985d-c22385156254 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.662081 Jul 26 12:51:43.724674 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 25/55] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:43 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:44.060455 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c58e6361-b56d-4884-b704-98d673232c50 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:44.061112 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c58e6361-b56d-4884-b704-98d673232c50 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:44.072437 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c58e6361-b56d-4884-b704-98d673232c50 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:44.073772 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c58e6361-b56d-4884-b704-98d673232c50 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:44.075659 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c58e6361-b56d-4884-b704-98d673232c50 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:44.077316 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c58e6361-b56d-4884-b704-98d673232c50 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:44.485355 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c58e6361-b56d-4884-b704-98d673232c50 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:44.496280 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c58e6361-b56d-4884-b704-98d673232c50 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.439611 Jul 26 12:51:44.510024 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 26/56] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:44 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:44.515478 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-46ddf0fe-5a57-43b2-a8ec-2ca94ca04281 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:44.516141 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-46ddf0fe-5a57-43b2-a8ec-2ca94ca04281 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:44.530849 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-46ddf0fe-5a57-43b2-a8ec-2ca94ca04281 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:44.532243 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-46ddf0fe-5a57-43b2-a8ec-2ca94ca04281 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:44.533053 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-46ddf0fe-5a57-43b2-a8ec-2ca94ca04281 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:44.533491 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-46ddf0fe-5a57-43b2-a8ec-2ca94ca04281 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:44.611016 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-46ddf0fe-5a57-43b2-a8ec-2ca94ca04281 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:44.620204 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-46ddf0fe-5a57-43b2-a8ec-2ca94ca04281 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:44.621788 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-46ddf0fe-5a57-43b2-a8ec-2ca94ca04281 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:44.623157 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-46ddf0fe-5a57-43b2-a8ec-2ca94ca04281 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1340 microversion: 2.20 time: 0.120662 Jul 26 12:51:44.623740 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 27/57] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:44 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1340 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:51:44.700403 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-f546629a-7667-4438-82a1-fe136b8108c1 req-bb006e83-ff6b-4392-a3a4-23c0b58a92c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13491d52-d823-4b46-9537-93441e1df6e3", "tag": "0b6d5dd0-f483-4401-bba0-62699172f404"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:44.715168 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-f546629a-7667-4438-82a1-fe136b8108c1 req-bb006e83-ff6b-4392-a3a4-23c0b58a92c3 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:44.715949 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-f546629a-7667-4438-82a1-fe136b8108c1 req-bb006e83-ff6b-4392-a3a4-23c0b58a92c3 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:44.739187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-f546629a-7667-4438-82a1-fe136b8108c1 req-bb006e83-ff6b-4392-a3a4-23c0b58a92c3 service nova] Creating event network-changed:0b6d5dd0-f483-4401-bba0-62699172f404 for instance 13491d52-d823-4b46-9537-93441e1df6e3 on hv-cinder-85093 Jul 26 12:51:44.739751 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-f546629a-7667-4438-82a1-fe136b8108c1 req-bb006e83-ff6b-4392-a3a4-23c0b58a92c3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129307) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 12:51:44.740921 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-074ffae6-545e-4dc4-889a-78e4557877f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:44.741360 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-074ffae6-545e-4dc4-889a-78e4557877f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:44.742126 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-074ffae6-545e-4dc4-889a-78e4557877f1 None None] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:44.742542 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-074ffae6-545e-4dc4-889a-78e4557877f1 None None] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:44.752466 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.compute.rpcapi [None req-074ffae6-545e-4dc4-889a-78e4557877f1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 12:51:44.753787 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-074ffae6-545e-4dc4-889a-78e4557877f1 None None] Releasing lock "compute-rpcapi-router" {{(pid=129307) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 12:51:44.772665 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-074ffae6-545e-4dc4-889a-78e4557877f1 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146419 Jul 26 12:51:44.773410 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 28/58] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:51:44.783584 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c9938088-1468-4a11-b86d-b0d5a5db73ee tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:44.784624 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c9938088-1468-4a11-b86d-b0d5a5db73ee tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:44.792161 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c9938088-1468-4a11-b86d-b0d5a5db73ee tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:44.792832 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c9938088-1468-4a11-b86d-b0d5a5db73ee tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:44.793908 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c9938088-1468-4a11-b86d-b0d5a5db73ee tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:44.794485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c9938088-1468-4a11-b86d-b0d5a5db73ee tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:44.837074 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=20 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:44.865951 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-89668e12-173f-4d2b-bc4e-dfdfab9a0b19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:44.877583 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-89668e12-173f-4d2b-bc4e-dfdfab9a0b19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 1.487754 Jul 26 12:51:44.878185 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:43 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:45.097962 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c9938088-1468-4a11-b86d-b0d5a5db73ee tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:45.142460 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c9938088-1468-4a11-b86d-b0d5a5db73ee tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.366276 Jul 26 12:51:45.144172 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 29/60] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:44 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:45.518105 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-99280dff-2bcb-4868-bdbb-fdb02d6d0d19 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:45.520458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-99280dff-2bcb-4868-bdbb-fdb02d6d0d19 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:45.535349 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-99280dff-2bcb-4868-bdbb-fdb02d6d0d19 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:45.538843 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-99280dff-2bcb-4868-bdbb-fdb02d6d0d19 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:45.540076 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-99280dff-2bcb-4868-bdbb-fdb02d6d0d19 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:45.543916 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-99280dff-2bcb-4868-bdbb-fdb02d6d0d19 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:45.649701 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d80d8685-57d1-4916-b8de-ebf4b661435a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:45.650889 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d80d8685-57d1-4916-b8de-ebf4b661435a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:45.657855 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d80d8685-57d1-4916-b8de-ebf4b661435a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:45.658643 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d80d8685-57d1-4916-b8de-ebf4b661435a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:45.660035 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d80d8685-57d1-4916-b8de-ebf4b661435a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:45.660684 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d80d8685-57d1-4916-b8de-ebf4b661435a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:45.760095 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d80d8685-57d1-4916-b8de-ebf4b661435a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:45.766399 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=100 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:45.773509 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d80d8685-57d1-4916-b8de-ebf4b661435a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:45.775858 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d80d8685-57d1-4916-b8de-ebf4b661435a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:45.777352 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d80d8685-57d1-4916-b8de-ebf4b661435a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1340 microversion: 2.20 time: 0.132355 Jul 26 12:51:45.778748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 30/61] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:45 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1340 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:51:45.909535 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-517e8133-2253-4a47-94fb-e88fd525cca0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:45.922735 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-517e8133-2253-4a47-94fb-e88fd525cca0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:45.950316 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-517e8133-2253-4a47-94fb-e88fd525cca0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:45.951213 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-517e8133-2253-4a47-94fb-e88fd525cca0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:45.952404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-99280dff-2bcb-4868-bdbb-fdb02d6d0d19 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:45.954994 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-517e8133-2253-4a47-94fb-e88fd525cca0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:45.956145 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-517e8133-2253-4a47-94fb-e88fd525cca0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:45.969626 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-99280dff-2bcb-4868-bdbb-fdb02d6d0d19 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.455552 Jul 26 12:51:45.972947 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 32/62] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:45 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:46.326875 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-517e8133-2253-4a47-94fb-e88fd525cca0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:46.339266 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-517e8133-2253-4a47-94fb-e88fd525cca0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.438189 Jul 26 12:51:46.340719 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 31/63] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:45 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:46.358799 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-426968a8-b928-40ec-8c6c-88f5e230b13b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:46.359424 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-426968a8-b928-40ec-8c6c-88f5e230b13b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:46.369230 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-426968a8-b928-40ec-8c6c-88f5e230b13b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:46.369688 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-426968a8-b928-40ec-8c6c-88f5e230b13b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:46.370504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-426968a8-b928-40ec-8c6c-88f5e230b13b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:46.370907 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-426968a8-b928-40ec-8c6c-88f5e230b13b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:46.387384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=30 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:46.403762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-98fa7e80-bad1-4e43-a70f-ab0a7c867920 req-bd6f0af8-9ff4-4785-9569-4691d727e5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a767a6a-b160-4f7d-970f-c45ff5bc1566", "tag": "34328d9b-7b53-457f-a58d-3371c1433b29"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:46.469992 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-98fa7e80-bad1-4e43-a70f-ab0a7c867920 req-bd6f0af8-9ff4-4785-9569-4691d727e5e8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:46.471383 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-98fa7e80-bad1-4e43-a70f-ab0a7c867920 req-bd6f0af8-9ff4-4785-9569-4691d727e5e8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:46.528557 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-98fa7e80-bad1-4e43-a70f-ab0a7c867920 req-bd6f0af8-9ff4-4785-9569-4691d727e5e8 service nova] Creating event network-changed:34328d9b-7b53-457f-a58d-3371c1433b29 for instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 on hv-cinder-85093 Jul 26 12:51:46.537678 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-98fa7e80-bad1-4e43-a70f-ab0a7c867920 req-bd6f0af8-9ff4-4785-9569-4691d727e5e8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129308) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 12:51:46.540198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5049147a-eb3b-46f8-8f36-436a13dd06d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:46.541329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5049147a-eb3b-46f8-8f36-436a13dd06d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:46.545462 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5049147a-eb3b-46f8-8f36-436a13dd06d5 None None] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:46.546183 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5049147a-eb3b-46f8-8f36-436a13dd06d5 None None] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:46.566585 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.compute.rpcapi [None req-5049147a-eb3b-46f8-8f36-436a13dd06d5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 12:51:46.568387 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5049147a-eb3b-46f8-8f36-436a13dd06d5 None None] Releasing lock "compute-rpcapi-router" {{(pid=129308) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 12:51:46.604673 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-5049147a-eb3b-46f8-8f36-436a13dd06d5 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.591005 Jul 26 12:51:46.611903 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 33/64] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:51:46.658273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-426968a8-b928-40ec-8c6c-88f5e230b13b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:46.669979 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-426968a8-b928-40ec-8c6c-88f5e230b13b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.327963 Jul 26 12:51:46.672239 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 32/65] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:46 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:46.813081 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-24144285-c162-4311-8741-9dc0f7606aa6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:46.814352 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-24144285-c162-4311-8741-9dc0f7606aa6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:46.826140 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-24144285-c162-4311-8741-9dc0f7606aa6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:46.826866 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-24144285-c162-4311-8741-9dc0f7606aa6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:46.828012 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-24144285-c162-4311-8741-9dc0f7606aa6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:46.828933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-24144285-c162-4311-8741-9dc0f7606aa6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:46.992792 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-24144285-c162-4311-8741-9dc0f7606aa6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:47.002474 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-46af1f37-4f47-4dcd-9120-5b2977aa1d56 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:47.003125 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-46af1f37-4f47-4dcd-9120-5b2977aa1d56 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:47.007353 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-24144285-c162-4311-8741-9dc0f7606aa6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:47.008924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-24144285-c162-4311-8741-9dc0f7606aa6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:47.017471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-46af1f37-4f47-4dcd-9120-5b2977aa1d56 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:47.018194 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-46af1f37-4f47-4dcd-9120-5b2977aa1d56 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:47.019146 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-46af1f37-4f47-4dcd-9120-5b2977aa1d56 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:47.019769 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-46af1f37-4f47-4dcd-9120-5b2977aa1d56 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:47.034307 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-24144285-c162-4311-8741-9dc0f7606aa6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1340 microversion: 2.20 time: 0.218622 Jul 26 12:51:47.050047 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:46 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1340 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:51:47.364180 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7c13f000-5161-4721-81aa-27e41ab48f66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:47.365453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7c13f000-5161-4721-81aa-27e41ab48f66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:47.377748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-46af1f37-4f47-4dcd-9120-5b2977aa1d56 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:47.386789 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c13f000-5161-4721-81aa-27e41ab48f66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:47.387463 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c13f000-5161-4721-81aa-27e41ab48f66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:47.389646 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c13f000-5161-4721-81aa-27e41ab48f66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:47.391889 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-46af1f37-4f47-4dcd-9120-5b2977aa1d56 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.393807 Jul 26 12:51:47.392894 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 33/67] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:46 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:51:47.393176 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c13f000-5161-4721-81aa-27e41ab48f66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:47.408365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=100 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:47.697720 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8088f5a4-ba80-4e82-8e95-87b8dd471ec4 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:47.698364 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8088f5a4-ba80-4e82-8e95-87b8dd471ec4 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:47.726198 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8088f5a4-ba80-4e82-8e95-87b8dd471ec4 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:47.728328 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8088f5a4-ba80-4e82-8e95-87b8dd471ec4 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:47.729586 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8088f5a4-ba80-4e82-8e95-87b8dd471ec4 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:47.731007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8088f5a4-ba80-4e82-8e95-87b8dd471ec4 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:48.136500 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7c13f000-5161-4721-81aa-27e41ab48f66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:48.156096 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7c13f000-5161-4721-81aa-27e41ab48f66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.795566 Jul 26 12:51:48.158947 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 35/68] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:47 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:48.172551 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ce1107c0-e2de-4abc-89bf-6e2510f54464 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:48.177580 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ce1107c0-e2de-4abc-89bf-6e2510f54464 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:48.191954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ce1107c0-e2de-4abc-89bf-6e2510f54464 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:48.193101 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ce1107c0-e2de-4abc-89bf-6e2510f54464 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:48.196501 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ce1107c0-e2de-4abc-89bf-6e2510f54464 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:48.197438 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ce1107c0-e2de-4abc-89bf-6e2510f54464 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:48.351051 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ce1107c0-e2de-4abc-89bf-6e2510f54464 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:48.374334 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ce1107c0-e2de-4abc-89bf-6e2510f54464 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:48.374334 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ce1107c0-e2de-4abc-89bf-6e2510f54464 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:48.374334 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ce1107c0-e2de-4abc-89bf-6e2510f54464 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1340 microversion: 2.20 time: 0.201564 Jul 26 12:51:48.375678 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 36/69] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:48 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1340 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:51:48.413859 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ca3705c1-3109-4dae-90e4-02ea52d1bce7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:48.414467 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ca3705c1-3109-4dae-90e4-02ea52d1bce7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:48.422251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ca3705c1-3109-4dae-90e4-02ea52d1bce7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:48.422700 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ca3705c1-3109-4dae-90e4-02ea52d1bce7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:48.423475 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ca3705c1-3109-4dae-90e4-02ea52d1bce7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:48.428509 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ca3705c1-3109-4dae-90e4-02ea52d1bce7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:49.180293 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8088f5a4-ba80-4e82-8e95-87b8dd471ec4 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:49.190059 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8088f5a4-ba80-4e82-8e95-87b8dd471ec4 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 1.499362 Jul 26 12:51:49.190961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 34/70] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:47 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:49.200530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-efc24d2c-ac44-4d5d-a1f7-5689e3685914 req-0adfc4ef-63ea-4e29-bdf5-e1bac6ffeec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b250f71-ee8b-4975-b24b-3984e8b02c6b", "tag": "fb356747-cdb9-4a2f-9a9d-4f55749ff5fd"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:49.227797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-efc24d2c-ac44-4d5d-a1f7-5689e3685914 req-0adfc4ef-63ea-4e29-bdf5-e1bac6ffeec4 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:49.228753 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-efc24d2c-ac44-4d5d-a1f7-5689e3685914 req-0adfc4ef-63ea-4e29-bdf5-e1bac6ffeec4 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:49.263137 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-efc24d2c-ac44-4d5d-a1f7-5689e3685914 req-0adfc4ef-63ea-4e29-bdf5-e1bac6ffeec4 service nova] Creating event network-changed:fb356747-cdb9-4a2f-9a9d-4f55749ff5fd for instance 2b250f71-ee8b-4975-b24b-3984e8b02c6b on hv-cinder-85093 Jul 26 12:51:49.277377 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-efc24d2c-ac44-4d5d-a1f7-5689e3685914 req-0adfc4ef-63ea-4e29-bdf5-e1bac6ffeec4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084703 Jul 26 12:51:49.279923 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 35/71] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:51:49.293851 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2cc5d855-00d9-4de1-ba72-8e650cdafb03 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:49.297907 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2cc5d855-00d9-4de1-ba72-8e650cdafb03 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:49.324224 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2cc5d855-00d9-4de1-ba72-8e650cdafb03 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:49.325504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2cc5d855-00d9-4de1-ba72-8e650cdafb03 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:49.329232 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2cc5d855-00d9-4de1-ba72-8e650cdafb03 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:49.331017 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2cc5d855-00d9-4de1-ba72-8e650cdafb03 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:49.735992 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ca3705c1-3109-4dae-90e4-02ea52d1bce7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:49.751575 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ca3705c1-3109-4dae-90e4-02ea52d1bce7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 1.341832 Jul 26 12:51:49.774280 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 37/72] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:48 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:51:49.792092 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-34929879-bec3-4888-83a6-aabc659d7027 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:49.793142 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-34929879-bec3-4888-83a6-aabc659d7027 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:49.800523 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-34929879-bec3-4888-83a6-aabc659d7027 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:49.801617 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-34929879-bec3-4888-83a6-aabc659d7027 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:49.804480 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-34929879-bec3-4888-83a6-aabc659d7027 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:49.806810 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-34929879-bec3-4888-83a6-aabc659d7027 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:49.960376 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-34929879-bec3-4888-83a6-aabc659d7027 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:49.987066 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-34929879-bec3-4888-83a6-aabc659d7027 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:49.993884 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-34929879-bec3-4888-83a6-aabc659d7027 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:49.998500 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-34929879-bec3-4888-83a6-aabc659d7027 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1340 microversion: 2.20 time: 0.220508 Jul 26 12:51:50.002920 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 38/73] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:49 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1340 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:51:50.088308 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2cc5d855-00d9-4de1-ba72-8e650cdafb03 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:50.105182 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2cc5d855-00d9-4de1-ba72-8e650cdafb03 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.823541 Jul 26 12:51:50.105783 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 36/74] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:49 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:50.215322 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e629e126-5348-41de-89e7-cb4e072e603e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:50.216300 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e629e126-5348-41de-89e7-cb4e072e603e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:50.225447 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e629e126-5348-41de-89e7-cb4e072e603e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:50.226530 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e629e126-5348-41de-89e7-cb4e072e603e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:50.230056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e629e126-5348-41de-89e7-cb4e072e603e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:50.233092 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e629e126-5348-41de-89e7-cb4e072e603e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:50.564591 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e629e126-5348-41de-89e7-cb4e072e603e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:50.573759 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e629e126-5348-41de-89e7-cb4e072e603e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.362130 Jul 26 12:51:50.575103 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 39/75] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:50 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:50.785381 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-833f5b51-a7b1-493e-8f9f-9105a3709e4c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:50.786569 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-833f5b51-a7b1-493e-8f9f-9105a3709e4c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:50.802668 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-833f5b51-a7b1-493e-8f9f-9105a3709e4c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:50.804282 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-833f5b51-a7b1-493e-8f9f-9105a3709e4c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:50.807158 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-833f5b51-a7b1-493e-8f9f-9105a3709e4c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:50.812417 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-833f5b51-a7b1-493e-8f9f-9105a3709e4c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:51.035999 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7e9543ed-23f5-447d-8152-352241d26ea5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:51.037203 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7e9543ed-23f5-447d-8152-352241d26ea5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:51.048817 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7e9543ed-23f5-447d-8152-352241d26ea5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:51.057742 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7e9543ed-23f5-447d-8152-352241d26ea5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:51.058778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7e9543ed-23f5-447d-8152-352241d26ea5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:51.059395 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7e9543ed-23f5-447d-8152-352241d26ea5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:51.406899 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-833f5b51-a7b1-493e-8f9f-9105a3709e4c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:51.415171 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-833f5b51-a7b1-493e-8f9f-9105a3709e4c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.634431 Jul 26 12:51:51.416421 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 37/76] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:50 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:51.422699 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3be1c237-a272-4d1d-a40f-1816155de67b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:51.423505 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3be1c237-a272-4d1d-a40f-1816155de67b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:51.434012 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3be1c237-a272-4d1d-a40f-1816155de67b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:51.435674 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3be1c237-a272-4d1d-a40f-1816155de67b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:51.436600 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3be1c237-a272-4d1d-a40f-1816155de67b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:51.437178 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3be1c237-a272-4d1d-a40f-1816155de67b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:51.650720 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7e9543ed-23f5-447d-8152-352241d26ea5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:51.659773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3be1c237-a272-4d1d-a40f-1816155de67b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:51.663669 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7e9543ed-23f5-447d-8152-352241d26ea5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:51.673004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7e9543ed-23f5-447d-8152-352241d26ea5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:51.675000 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7e9543ed-23f5-447d-8152-352241d26ea5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.642853 Jul 26 12:51:51.675690 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 40/77] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:51 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:51:51.682614 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-89c8fd7c-b023-4dfd-9a03-8f05d39c1ec3 req-9bd00035-1144-4c81-ba21-48f7a20d8d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4", "tag": "edf8881f-7a20-4fbe-8846-b9ee12ada969"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:51.691607 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3be1c237-a272-4d1d-a40f-1816155de67b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.269753 Jul 26 12:51:51.696590 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 38/78] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:51 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:51.702153 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:51.710576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-89c8fd7c-b023-4dfd-9a03-8f05d39c1ec3 req-9bd00035-1144-4c81-ba21-48f7a20d8d43 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:51.714626 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-89c8fd7c-b023-4dfd-9a03-8f05d39c1ec3 req-9bd00035-1144-4c81-ba21-48f7a20d8d43 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:51.723161 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9a2b9cc3-72c7-48ae-8847-5ae71188ca9b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:51.724687 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9a2b9cc3-72c7-48ae-8847-5ae71188ca9b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:51.737638 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9a2b9cc3-72c7-48ae-8847-5ae71188ca9b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:51.738084 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9a2b9cc3-72c7-48ae-8847-5ae71188ca9b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:51.739017 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9a2b9cc3-72c7-48ae-8847-5ae71188ca9b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:51.739598 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9a2b9cc3-72c7-48ae-8847-5ae71188ca9b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:51.741150 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-89c8fd7c-b023-4dfd-9a03-8f05d39c1ec3 req-9bd00035-1144-4c81-ba21-48f7a20d8d43 service nova] Creating event network-changed:edf8881f-7a20-4fbe-8846-b9ee12ada969 for instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 on hv-cinder-85093 Jul 26 12:51:51.761447 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-89c8fd7c-b023-4dfd-9a03-8f05d39c1ec3 req-9bd00035-1144-4c81-ba21-48f7a20d8d43 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082279 Jul 26 12:51:51.762061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 41/79] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:51:52.105224 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9a2b9cc3-72c7-48ae-8847-5ae71188ca9b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:52.121739 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9a2b9cc3-72c7-48ae-8847-5ae71188ca9b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.404524 Jul 26 12:51:52.124544 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 39/80] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:51 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:52.332746 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-7d79984e-a1b6-44bd-a2bc-55b482efd388 req-616d64f9-5f2d-4a93-9a53-75c86563dff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20220b7e-2897-4f0c-98da-3f352aa39ec2", "tag": "32e67b58-c4c4-4a07-b551-08232595ea42"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:51:52.356137 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-7d79984e-a1b6-44bd-a2bc-55b482efd388 req-616d64f9-5f2d-4a93-9a53-75c86563dff4 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:52.356934 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-7d79984e-a1b6-44bd-a2bc-55b482efd388 req-616d64f9-5f2d-4a93-9a53-75c86563dff4 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:52.374596 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-7d79984e-a1b6-44bd-a2bc-55b482efd388 req-616d64f9-5f2d-4a93-9a53-75c86563dff4 service nova] Creating event network-changed:32e67b58-c4c4-4a07-b551-08232595ea42 for instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 on hv-cinder-85093 Jul 26 12:51:52.380034 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-7d79984e-a1b6-44bd-a2bc-55b482efd388 req-616d64f9-5f2d-4a93-9a53-75c86563dff4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053751 Jul 26 12:51:52.380855 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 42/81] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:51:52.435944 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e128f0fe-fcdb-4175-b321-054d66748893 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:52.436559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e128f0fe-fcdb-4175-b321-054d66748893 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:52.444266 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e128f0fe-fcdb-4175-b321-054d66748893 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:52.444705 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e128f0fe-fcdb-4175-b321-054d66748893 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:52.445833 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e128f0fe-fcdb-4175-b321-054d66748893 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:52.445946 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e128f0fe-fcdb-4175-b321-054d66748893 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:52.699373 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-af103261-e94f-4a05-8ba2-515223a24a2f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:52.700125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-af103261-e94f-4a05-8ba2-515223a24a2f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:52.706398 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-af103261-e94f-4a05-8ba2-515223a24a2f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:52.706854 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-af103261-e94f-4a05-8ba2-515223a24a2f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:52.707626 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-af103261-e94f-4a05-8ba2-515223a24a2f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:52.708087 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-af103261-e94f-4a05-8ba2-515223a24a2f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:52.907332 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e128f0fe-fcdb-4175-b321-054d66748893 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:52.917766 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e128f0fe-fcdb-4175-b321-054d66748893 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.485824 Jul 26 12:51:52.918476 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 40/82] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:52 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:52.929341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-10f9caf1-3822-4652-9cd6-02b6f915a9ea tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:52.930270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-10f9caf1-3822-4652-9cd6-02b6f915a9ea tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:52.945466 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10f9caf1-3822-4652-9cd6-02b6f915a9ea tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:52.946195 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10f9caf1-3822-4652-9cd6-02b6f915a9ea tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:52.947358 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10f9caf1-3822-4652-9cd6-02b6f915a9ea tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:52.948226 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10f9caf1-3822-4652-9cd6-02b6f915a9ea tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:53.125854 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-af103261-e94f-4a05-8ba2-515223a24a2f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:53.157965 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-af103261-e94f-4a05-8ba2-515223a24a2f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:53.166448 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-af103261-e94f-4a05-8ba2-515223a24a2f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:53.172368 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-af103261-e94f-4a05-8ba2-515223a24a2f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.475606 Jul 26 12:51:53.173240 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 43/83] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:52 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:51:53.181821 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-10f9caf1-3822-4652-9cd6-02b6f915a9ea tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:53.191480 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-10f9caf1-3822-4652-9cd6-02b6f915a9ea tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.266699 Jul 26 12:51:53.192829 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 41/84] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:52 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:53.197274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-907f08cd-b01c-445a-ad5a-d3d9774b57e7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:53.199375 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-907f08cd-b01c-445a-ad5a-d3d9774b57e7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:53.209074 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-907f08cd-b01c-445a-ad5a-d3d9774b57e7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:53.210011 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-907f08cd-b01c-445a-ad5a-d3d9774b57e7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:53.211162 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-907f08cd-b01c-445a-ad5a-d3d9774b57e7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:53.211679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-907f08cd-b01c-445a-ad5a-d3d9774b57e7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:53.374455 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-907f08cd-b01c-445a-ad5a-d3d9774b57e7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:53.382818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-907f08cd-b01c-445a-ad5a-d3d9774b57e7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.208346 Jul 26 12:51:53.387898 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 44/85] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:53 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:53.941950 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-95cefee7-eb90-42f8-bf48-171d894fbb13 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:53.942721 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-95cefee7-eb90-42f8-bf48-171d894fbb13 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:53.957224 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-95cefee7-eb90-42f8-bf48-171d894fbb13 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:53.957756 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-95cefee7-eb90-42f8-bf48-171d894fbb13 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:53.958842 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-95cefee7-eb90-42f8-bf48-171d894fbb13 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:53.959433 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-95cefee7-eb90-42f8-bf48-171d894fbb13 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:54.190887 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-95cefee7-eb90-42f8-bf48-171d894fbb13 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:54.197932 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-2496439f-be3c-421d-8c04-6075490a5fcf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:54.199258 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-2496439f-be3c-421d-8c04-6075490a5fcf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:54.201374 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-95cefee7-eb90-42f8-bf48-171d894fbb13 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.262865 Jul 26 12:51:54.202361 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 42/86] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:53 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:54.215101 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2496439f-be3c-421d-8c04-6075490a5fcf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:54.218440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1253c4fe-8f51-4347-922f-6a2e800b44e5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:54.218440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1253c4fe-8f51-4347-922f-6a2e800b44e5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:54.218705 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2496439f-be3c-421d-8c04-6075490a5fcf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:54.224151 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2496439f-be3c-421d-8c04-6075490a5fcf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:54.225206 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1253c4fe-8f51-4347-922f-6a2e800b44e5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:54.225734 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2496439f-be3c-421d-8c04-6075490a5fcf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:54.225843 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1253c4fe-8f51-4347-922f-6a2e800b44e5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:54.226588 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1253c4fe-8f51-4347-922f-6a2e800b44e5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:54.227020 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1253c4fe-8f51-4347-922f-6a2e800b44e5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:54.384759 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1253c4fe-8f51-4347-922f-6a2e800b44e5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:54.395254 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1253c4fe-8f51-4347-922f-6a2e800b44e5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.183890 Jul 26 12:51:54.396043 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 43/87] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:54 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:54.403175 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c72c9f11-01e0-4bb2-812d-7b46af83df44 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:54.404234 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c72c9f11-01e0-4bb2-812d-7b46af83df44 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:54.409849 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2496439f-be3c-421d-8c04-6075490a5fcf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:54.412244 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c72c9f11-01e0-4bb2-812d-7b46af83df44 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:54.413512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c72c9f11-01e0-4bb2-812d-7b46af83df44 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:54.414376 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c72c9f11-01e0-4bb2-812d-7b46af83df44 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:54.414939 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c72c9f11-01e0-4bb2-812d-7b46af83df44 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:54.420212 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2496439f-be3c-421d-8c04-6075490a5fcf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:54.422167 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2496439f-be3c-421d-8c04-6075490a5fcf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:54.423596 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-2496439f-be3c-421d-8c04-6075490a5fcf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.231982 Jul 26 12:51:54.424456 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 45/88] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:54 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:51:54.607151 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c72c9f11-01e0-4bb2-812d-7b46af83df44 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:54.619503 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c72c9f11-01e0-4bb2-812d-7b46af83df44 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.220217 Jul 26 12:51:54.620840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 44/89] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:54 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:51:55.223033 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-91cbdb4d-dfe2-44a6-8c6b-582bd6798f7d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:55.224028 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-91cbdb4d-dfe2-44a6-8c6b-582bd6798f7d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:55.234541 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-91cbdb4d-dfe2-44a6-8c6b-582bd6798f7d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:55.236743 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-91cbdb4d-dfe2-44a6-8c6b-582bd6798f7d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:55.239739 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-91cbdb4d-dfe2-44a6-8c6b-582bd6798f7d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:55.240174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-91cbdb4d-dfe2-44a6-8c6b-582bd6798f7d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:55.396177 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-91cbdb4d-dfe2-44a6-8c6b-582bd6798f7d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:55.404568 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-91cbdb4d-dfe2-44a6-8c6b-582bd6798f7d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.186095 Jul 26 12:51:55.405144 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 46/90] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:55 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:55.417630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-744ce6ae-8b0d-4618-a3a7-00cecccb0bda tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:55.418808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-744ce6ae-8b0d-4618-a3a7-00cecccb0bda tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:55.421011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=8 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:55.428660 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-744ce6ae-8b0d-4618-a3a7-00cecccb0bda tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:55.429433 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-744ce6ae-8b0d-4618-a3a7-00cecccb0bda tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:55.430520 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-744ce6ae-8b0d-4618-a3a7-00cecccb0bda tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:55.432063 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-744ce6ae-8b0d-4618-a3a7-00cecccb0bda tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:55.446204 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7222c678-de3a-4c0e-970a-2369ded691e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:55.446817 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7222c678-de3a-4c0e-970a-2369ded691e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:55.454035 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7222c678-de3a-4c0e-970a-2369ded691e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:55.454484 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7222c678-de3a-4c0e-970a-2369ded691e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:55.455570 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7222c678-de3a-4c0e-970a-2369ded691e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:55.456317 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7222c678-de3a-4c0e-970a-2369ded691e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:55.610025 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7222c678-de3a-4c0e-970a-2369ded691e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:55.622121 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-744ce6ae-8b0d-4618-a3a7-00cecccb0bda tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:55.622708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7222c678-de3a-4c0e-970a-2369ded691e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:55.624596 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7222c678-de3a-4c0e-970a-2369ded691e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:55.625988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7222c678-de3a-4c0e-970a-2369ded691e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.183673 Jul 26 12:51:55.636635 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-744ce6ae-8b0d-4618-a3a7-00cecccb0bda tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.220308 Jul 26 12:51:55.643349 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 47/91] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:55 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:51:55.648447 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 45/92] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:55 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:55.649718 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-49509919-d4b7-4487-a9b0-8c5abc1dcfde tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:55.650667 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-49509919-d4b7-4487-a9b0-8c5abc1dcfde tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:55.657179 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-49509919-d4b7-4487-a9b0-8c5abc1dcfde tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:55.657540 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-49509919-d4b7-4487-a9b0-8c5abc1dcfde tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:55.658788 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-49509919-d4b7-4487-a9b0-8c5abc1dcfde tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:55.659275 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-49509919-d4b7-4487-a9b0-8c5abc1dcfde tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:55.886017 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-49509919-d4b7-4487-a9b0-8c5abc1dcfde tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:55.900591 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-49509919-d4b7-4487-a9b0-8c5abc1dcfde tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.255765 Jul 26 12:51:55.901290 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 48/93] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:55 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:56.426649 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-87a06439-331f-40e6-93e5-851738c1e938 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:56.427318 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-87a06439-331f-40e6-93e5-851738c1e938 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:56.434042 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-87a06439-331f-40e6-93e5-851738c1e938 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:56.434417 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-87a06439-331f-40e6-93e5-851738c1e938 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:56.435189 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-87a06439-331f-40e6-93e5-851738c1e938 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:56.436330 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-87a06439-331f-40e6-93e5-851738c1e938 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:56.578910 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-87a06439-331f-40e6-93e5-851738c1e938 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:56.588416 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-87a06439-331f-40e6-93e5-851738c1e938 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.165699 Jul 26 12:51:56.589042 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 46/94] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:56 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:56.651022 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e88ca932-849b-4ac8-8c3a-253f743ef3bf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:56.651827 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e88ca932-849b-4ac8-8c3a-253f743ef3bf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:56.657815 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:56.659387 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e88ca932-849b-4ac8-8c3a-253f743ef3bf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:56.659983 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e88ca932-849b-4ac8-8c3a-253f743ef3bf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:56.660930 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e88ca932-849b-4ac8-8c3a-253f743ef3bf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:56.661519 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e88ca932-849b-4ac8-8c3a-253f743ef3bf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:56.661740 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-54434819-6a31-4df1-bf85-89df77179a01 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:56.662544 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-54434819-6a31-4df1-bf85-89df77179a01 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:56.669486 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-54434819-6a31-4df1-bf85-89df77179a01 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:56.669943 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-54434819-6a31-4df1-bf85-89df77179a01 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:56.670939 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-54434819-6a31-4df1-bf85-89df77179a01 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:56.671455 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-54434819-6a31-4df1-bf85-89df77179a01 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:56.847006 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-54434819-6a31-4df1-bf85-89df77179a01 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:56.857351 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-54434819-6a31-4df1-bf85-89df77179a01 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.200500 Jul 26 12:51:56.858756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e88ca932-849b-4ac8-8c3a-253f743ef3bf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:56.859173 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 47/95] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:56 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:51:56.883054 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e88ca932-849b-4ac8-8c3a-253f743ef3bf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:56.884957 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e88ca932-849b-4ac8-8c3a-253f743ef3bf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:56.886165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e88ca932-849b-4ac8-8c3a-253f743ef3bf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.239703 Jul 26 12:51:56.886791 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 49/96] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:56 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:51:56.922178 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-7e59e3ff-8592-40c1-b79a-8919a5d1d3b7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:56.922958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-7e59e3ff-8592-40c1-b79a-8919a5d1d3b7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:56.931266 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7e59e3ff-8592-40c1-b79a-8919a5d1d3b7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:56.931808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7e59e3ff-8592-40c1-b79a-8919a5d1d3b7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:56.932951 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7e59e3ff-8592-40c1-b79a-8919a5d1d3b7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:56.933619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7e59e3ff-8592-40c1-b79a-8919a5d1d3b7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:56.939010 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=100 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:57.258600 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-7e59e3ff-8592-40c1-b79a-8919a5d1d3b7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:57.279041 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-7e59e3ff-8592-40c1-b79a-8919a5d1d3b7 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.361336 Jul 26 12:51:57.279945 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 48/97] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:56 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:57.611598 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ab8f2e97-cee2-46b3-9472-2dfed6b6dc8f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:57.612562 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ab8f2e97-cee2-46b3-9472-2dfed6b6dc8f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:57.630369 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ab8f2e97-cee2-46b3-9472-2dfed6b6dc8f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:57.630369 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ab8f2e97-cee2-46b3-9472-2dfed6b6dc8f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:57.630369 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ab8f2e97-cee2-46b3-9472-2dfed6b6dc8f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:57.630369 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ab8f2e97-cee2-46b3-9472-2dfed6b6dc8f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:57.826761 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ab8f2e97-cee2-46b3-9472-2dfed6b6dc8f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:57.835851 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ab8f2e97-cee2-46b3-9472-2dfed6b6dc8f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.228834 Jul 26 12:51:57.836497 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 50/98] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:57 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:57.884424 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d6dbc03e-92c8-4bce-ad73-e4464acb67f1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:57.885293 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d6dbc03e-92c8-4bce-ad73-e4464acb67f1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:57.892799 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6dbc03e-92c8-4bce-ad73-e4464acb67f1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:57.893598 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6dbc03e-92c8-4bce-ad73-e4464acb67f1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:57.894480 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6dbc03e-92c8-4bce-ad73-e4464acb67f1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:57.895025 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6dbc03e-92c8-4bce-ad73-e4464acb67f1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:57.914531 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-138bd0c4-e2ea-4834-b053-239a5a72e08e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:57.920000 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-138bd0c4-e2ea-4834-b053-239a5a72e08e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:57.930237 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-138bd0c4-e2ea-4834-b053-239a5a72e08e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:57.931445 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-138bd0c4-e2ea-4834-b053-239a5a72e08e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:57.933747 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-138bd0c4-e2ea-4834-b053-239a5a72e08e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:57.934346 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-138bd0c4-e2ea-4834-b053-239a5a72e08e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:58.074907 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d6dbc03e-92c8-4bce-ad73-e4464acb67f1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:58.083454 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d6dbc03e-92c8-4bce-ad73-e4464acb67f1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.203866 Jul 26 12:51:58.084256 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 49/99] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:57 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:58.101074 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-138bd0c4-e2ea-4834-b053-239a5a72e08e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:58.109163 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-138bd0c4-e2ea-4834-b053-239a5a72e08e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:58.110679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-138bd0c4-e2ea-4834-b053-239a5a72e08e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:58.111855 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-138bd0c4-e2ea-4834-b053-239a5a72e08e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.205129 Jul 26 12:51:58.112413 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 51/100] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:57 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:51:58.300005 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-554c376a-40e9-433a-a3ac-83f248e6e30d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:58.300677 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-554c376a-40e9-433a-a3ac-83f248e6e30d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:58.307442 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-554c376a-40e9-433a-a3ac-83f248e6e30d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:58.307926 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-554c376a-40e9-433a-a3ac-83f248e6e30d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:58.308700 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-554c376a-40e9-433a-a3ac-83f248e6e30d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:58.309139 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-554c376a-40e9-433a-a3ac-83f248e6e30d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:58.452902 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-554c376a-40e9-433a-a3ac-83f248e6e30d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:58.461200 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-554c376a-40e9-433a-a3ac-83f248e6e30d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.165618 Jul 26 12:51:58.461775 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 50/101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:58 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:58.859054 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6f810ad7-f015-4674-a54e-9b17a866f09b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:58.859669 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6f810ad7-f015-4674-a54e-9b17a866f09b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:58.866504 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6f810ad7-f015-4674-a54e-9b17a866f09b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:58.867330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6f810ad7-f015-4674-a54e-9b17a866f09b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:58.868012 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6f810ad7-f015-4674-a54e-9b17a866f09b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:58.868447 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6f810ad7-f015-4674-a54e-9b17a866f09b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:59.018846 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6f810ad7-f015-4674-a54e-9b17a866f09b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:59.028475 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6f810ad7-f015-4674-a54e-9b17a866f09b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.173989 Jul 26 12:51:59.029384 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 52/102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:58 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:59.103664 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ad18330d-1836-4659-b94c-8d5a5488cf20 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:59.104390 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ad18330d-1836-4659-b94c-8d5a5488cf20 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:59.111233 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ad18330d-1836-4659-b94c-8d5a5488cf20 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:59.111233 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ad18330d-1836-4659-b94c-8d5a5488cf20 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:59.111779 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ad18330d-1836-4659-b94c-8d5a5488cf20 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:59.112218 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ad18330d-1836-4659-b94c-8d5a5488cf20 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:59.136896 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0392bfed-ae2c-4068-8ef4-71456ad041e1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:59.137652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0392bfed-ae2c-4068-8ef4-71456ad041e1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:59.144880 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0392bfed-ae2c-4068-8ef4-71456ad041e1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:59.145444 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0392bfed-ae2c-4068-8ef4-71456ad041e1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:59.146216 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0392bfed-ae2c-4068-8ef4-71456ad041e1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:59.146774 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0392bfed-ae2c-4068-8ef4-71456ad041e1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:59.151298 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=100 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:51:59.293028 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0392bfed-ae2c-4068-8ef4-71456ad041e1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:59.301722 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0392bfed-ae2c-4068-8ef4-71456ad041e1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:59.303938 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0392bfed-ae2c-4068-8ef4-71456ad041e1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:59.305042 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0392bfed-ae2c-4068-8ef4-71456ad041e1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.172837 Jul 26 12:51:59.305690 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 53/103] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:51:59 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:51:59.312988 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ad18330d-1836-4659-b94c-8d5a5488cf20 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:59.321896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ad18330d-1836-4659-b94c-8d5a5488cf20 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.222110 Jul 26 12:51:59.335738 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 51/104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:59 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:51:59.483210 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-2bb05277-dd18-4945-9bc6-d7feeab0b2f1 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:51:59.484101 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-2bb05277-dd18-4945-9bc6-d7feeab0b2f1 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:51:59.490117 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2bb05277-dd18-4945-9bc6-d7feeab0b2f1 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:59.491255 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2bb05277-dd18-4945-9bc6-d7feeab0b2f1 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:59.492072 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2bb05277-dd18-4945-9bc6-d7feeab0b2f1 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:51:59.492580 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2bb05277-dd18-4945-9bc6-d7feeab0b2f1 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:51:59.627364 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2bb05277-dd18-4945-9bc6-d7feeab0b2f1 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:51:59.639997 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-2bb05277-dd18-4945-9bc6-d7feeab0b2f1 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.161558 Jul 26 12:51:59.640569 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 54/105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:51:59 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:00.052037 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-32f2e99e-073e-454a-91f2-1acc4c04b6ef tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:00.053338 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-32f2e99e-073e-454a-91f2-1acc4c04b6ef tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:00.061074 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-32f2e99e-073e-454a-91f2-1acc4c04b6ef tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:00.062106 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-32f2e99e-073e-454a-91f2-1acc4c04b6ef tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:00.062916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-32f2e99e-073e-454a-91f2-1acc4c04b6ef tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:00.064260 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-32f2e99e-073e-454a-91f2-1acc4c04b6ef tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:00.261368 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-32f2e99e-073e-454a-91f2-1acc4c04b6ef tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:00.270026 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-32f2e99e-073e-454a-91f2-1acc4c04b6ef tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.222574 Jul 26 12:52:00.270616 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 52/106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:00 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:00.327304 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-48ae808e-e12e-4d0a-86f2-2698e65d31a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:00.327938 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-48ae808e-e12e-4d0a-86f2-2698e65d31a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:00.335877 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-48ae808e-e12e-4d0a-86f2-2698e65d31a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:00.337969 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-48ae808e-e12e-4d0a-86f2-2698e65d31a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:00.338771 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-48ae808e-e12e-4d0a-86f2-2698e65d31a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:00.339214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-48ae808e-e12e-4d0a-86f2-2698e65d31a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:00.343039 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-74e92261-d6f7-444a-8453-0a4900760e87 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:00.344078 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-74e92261-d6f7-444a-8453-0a4900760e87 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:00.351858 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-74e92261-d6f7-444a-8453-0a4900760e87 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:00.352606 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-74e92261-d6f7-444a-8453-0a4900760e87 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:00.353736 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-74e92261-d6f7-444a-8453-0a4900760e87 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:00.354580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-74e92261-d6f7-444a-8453-0a4900760e87 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:00.528727 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-48ae808e-e12e-4d0a-86f2-2698e65d31a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:00.538840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-74e92261-d6f7-444a-8453-0a4900760e87 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:00.539399 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-48ae808e-e12e-4d0a-86f2-2698e65d31a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:00.541478 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-48ae808e-e12e-4d0a-86f2-2698e65d31a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:00.543804 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-48ae808e-e12e-4d0a-86f2-2698e65d31a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.219809 Jul 26 12:52:00.544654 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 55/107] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:00 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:00.547562 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-74e92261-d6f7-444a-8453-0a4900760e87 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.208591 Jul 26 12:52:00.548234 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 53/108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:00 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:00.665860 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9b4b24e0-995d-4bdd-8c30-782d8b8d6b7c tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:00.667120 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-9b4b24e0-995d-4bdd-8c30-782d8b8d6b7c tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:00.674125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9b4b24e0-995d-4bdd-8c30-782d8b8d6b7c tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:00.674804 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9b4b24e0-995d-4bdd-8c30-782d8b8d6b7c tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:00.675864 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9b4b24e0-995d-4bdd-8c30-782d8b8d6b7c tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:00.676507 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9b4b24e0-995d-4bdd-8c30-782d8b8d6b7c tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:00.842873 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-9b4b24e0-995d-4bdd-8c30-782d8b8d6b7c tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:00.852680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9b4b24e0-995d-4bdd-8c30-782d8b8d6b7c tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.193550 Jul 26 12:52:00.853538 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 56/109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:00 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:01.293923 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ddd07ed7-9037-402a-b71d-98f68654fdcc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:01.295790 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ddd07ed7-9037-402a-b71d-98f68654fdcc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:01.307305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ddd07ed7-9037-402a-b71d-98f68654fdcc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:01.308158 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ddd07ed7-9037-402a-b71d-98f68654fdcc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:01.309246 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ddd07ed7-9037-402a-b71d-98f68654fdcc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:01.309909 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ddd07ed7-9037-402a-b71d-98f68654fdcc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:01.571308 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-92b1200d-56d0-4301-a51b-37ecd8b7496c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:01.573027 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-92b1200d-56d0-4301-a51b-37ecd8b7496c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:01.580338 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-92b1200d-56d0-4301-a51b-37ecd8b7496c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:01.581370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-92b1200d-56d0-4301-a51b-37ecd8b7496c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:01.583092 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-92b1200d-56d0-4301-a51b-37ecd8b7496c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:01.583798 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-92b1200d-56d0-4301-a51b-37ecd8b7496c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:01.768799 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-92b1200d-56d0-4301-a51b-37ecd8b7496c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:01.779569 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-92b1200d-56d0-4301-a51b-37ecd8b7496c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:01.781802 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-92b1200d-56d0-4301-a51b-37ecd8b7496c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:01.783124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-92b1200d-56d0-4301-a51b-37ecd8b7496c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.217767 Jul 26 12:52:01.784000 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 57/110] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:01 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:01.790662 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-506a48ca-f4c5-40c8-b840-182b5139ab51 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:01.791523 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-506a48ca-f4c5-40c8-b840-182b5139ab51 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:01.798714 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-506a48ca-f4c5-40c8-b840-182b5139ab51 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:01.799772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-506a48ca-f4c5-40c8-b840-182b5139ab51 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:01.800373 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-506a48ca-f4c5-40c8-b840-182b5139ab51 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:01.800802 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-506a48ca-f4c5-40c8-b840-182b5139ab51 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:01.950790 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ddd07ed7-9037-402a-b71d-98f68654fdcc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:01.961401 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ddd07ed7-9037-402a-b71d-98f68654fdcc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.672480 Jul 26 12:52:01.962643 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 54/111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:01 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:01.968031 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5a0911e7-8c33-4014-8582-1b8a15df6a3b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:01.979164 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5a0911e7-8c33-4014-8582-1b8a15df6a3b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:01.986111 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-506a48ca-f4c5-40c8-b840-182b5139ab51 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:01.994775 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5a0911e7-8c33-4014-8582-1b8a15df6a3b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:01.996065 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-506a48ca-f4c5-40c8-b840-182b5139ab51 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.210804 Jul 26 12:52:01.996228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5a0911e7-8c33-4014-8582-1b8a15df6a3b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:01.997293 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 58/112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:01 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:02.006568 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5a0911e7-8c33-4014-8582-1b8a15df6a3b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:02.007275 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5a0911e7-8c33-4014-8582-1b8a15df6a3b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:02.484673 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5a0911e7-8c33-4014-8582-1b8a15df6a3b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:02.485321 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-dfc9863c-8a22-46b7-b25f-f4fa6347286f req-2ec098e4-494e-4664-9f99-7e2cdc347f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b250f71-ee8b-4975-b24b-3984e8b02c6b", "name": "network-vif-plugged", "status": "completed", "tag": "fb356747-cdb9-4a2f-9a9d-4f55749ff5fd"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:52:02.495990 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-dfc9863c-8a22-46b7-b25f-f4fa6347286f req-2ec098e4-494e-4664-9f99-7e2cdc347f35 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:02.496380 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5a0911e7-8c33-4014-8582-1b8a15df6a3b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.531872 Jul 26 12:52:02.496806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-dfc9863c-8a22-46b7-b25f-f4fa6347286f req-2ec098e4-494e-4664-9f99-7e2cdc347f35 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:02.497037 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 55/113] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:01 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:02.523949 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-dfc9863c-8a22-46b7-b25f-f4fa6347286f req-2ec098e4-494e-4664-9f99-7e2cdc347f35 service nova] Creating event network-vif-plugged:fb356747-cdb9-4a2f-9a9d-4f55749ff5fd for instance 2b250f71-ee8b-4975-b24b-3984e8b02c6b on hv-cinder-85093 Jul 26 12:52:02.527423 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-dfc9863c-8a22-46b7-b25f-f4fa6347286f req-2ec098e4-494e-4664-9f99-7e2cdc347f35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138257 Jul 26 12:52:02.528114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 59/114] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:52:02.808156 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3afce05f-9f53-4cfe-b16a-076d448a65e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:02.809223 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3afce05f-9f53-4cfe-b16a-076d448a65e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:02.816681 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3afce05f-9f53-4cfe-b16a-076d448a65e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:02.817218 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3afce05f-9f53-4cfe-b16a-076d448a65e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:02.818000 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3afce05f-9f53-4cfe-b16a-076d448a65e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:02.819167 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3afce05f-9f53-4cfe-b16a-076d448a65e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:02.988627 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f78f31b5-b773-4501-b5ad-c67f70bc7852 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:02.990021 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f78f31b5-b773-4501-b5ad-c67f70bc7852 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:03.001681 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3afce05f-9f53-4cfe-b16a-076d448a65e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:03.002511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f78f31b5-b773-4501-b5ad-c67f70bc7852 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:03.003281 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f78f31b5-b773-4501-b5ad-c67f70bc7852 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:03.004968 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f78f31b5-b773-4501-b5ad-c67f70bc7852 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:03.006801 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f78f31b5-b773-4501-b5ad-c67f70bc7852 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:03.012759 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3afce05f-9f53-4cfe-b16a-076d448a65e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:03.014290 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3afce05f-9f53-4cfe-b16a-076d448a65e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:03.015886 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3afce05f-9f53-4cfe-b16a-076d448a65e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.213111 Jul 26 12:52:03.016452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 56/115] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:02 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:03.021081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-42a95c0b-c6d5-4d68-9f7b-b01cd9819f6b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:03.022159 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-42a95c0b-c6d5-4d68-9f7b-b01cd9819f6b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:03.029061 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-42a95c0b-c6d5-4d68-9f7b-b01cd9819f6b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:03.029777 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-42a95c0b-c6d5-4d68-9f7b-b01cd9819f6b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:03.030880 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-42a95c0b-c6d5-4d68-9f7b-b01cd9819f6b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:03.031545 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-42a95c0b-c6d5-4d68-9f7b-b01cd9819f6b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:03.245003 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-42a95c0b-c6d5-4d68-9f7b-b01cd9819f6b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:03.253472 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-42a95c0b-c6d5-4d68-9f7b-b01cd9819f6b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.235976 Jul 26 12:52:03.267001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 57/116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:03 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:03.343452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f78f31b5-b773-4501-b5ad-c67f70bc7852 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:03.351837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f78f31b5-b773-4501-b5ad-c67f70bc7852 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.369997 Jul 26 12:52:03.352664 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 60/117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:02 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:03.516877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-df4e2fdd-34ee-402f-8e36-eb32b1773b5a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:03.517656 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-df4e2fdd-34ee-402f-8e36-eb32b1773b5a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:03.524044 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-df4e2fdd-34ee-402f-8e36-eb32b1773b5a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:03.524659 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-df4e2fdd-34ee-402f-8e36-eb32b1773b5a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:03.526082 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-df4e2fdd-34ee-402f-8e36-eb32b1773b5a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:03.526707 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-df4e2fdd-34ee-402f-8e36-eb32b1773b5a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:03.761475 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-df4e2fdd-34ee-402f-8e36-eb32b1773b5a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:03.771042 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-df4e2fdd-34ee-402f-8e36-eb32b1773b5a tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.257994 Jul 26 12:52:03.771697 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 58/118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:03 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:04.074408 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-deb69b02-9902-4118-bb78-51bace4e0a6f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:04.075932 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-deb69b02-9902-4118-bb78-51bace4e0a6f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:04.086392 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-deb69b02-9902-4118-bb78-51bace4e0a6f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:04.092292 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-deb69b02-9902-4118-bb78-51bace4e0a6f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:04.093345 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-deb69b02-9902-4118-bb78-51bace4e0a6f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:04.093953 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-deb69b02-9902-4118-bb78-51bace4e0a6f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:04.273792 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-dd6152f8-1da5-4b7e-8483-537a7d57c2f9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:04.274924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-dd6152f8-1da5-4b7e-8483-537a7d57c2f9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:04.285827 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dd6152f8-1da5-4b7e-8483-537a7d57c2f9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:04.286764 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dd6152f8-1da5-4b7e-8483-537a7d57c2f9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:04.288133 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dd6152f8-1da5-4b7e-8483-537a7d57c2f9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:04.288575 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dd6152f8-1da5-4b7e-8483-537a7d57c2f9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:04.599770 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-deb69b02-9902-4118-bb78-51bace4e0a6f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:04.610606 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-deb69b02-9902-4118-bb78-51bace4e0a6f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:04.612571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-deb69b02-9902-4118-bb78-51bace4e0a6f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:04.614105 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-deb69b02-9902-4118-bb78-51bace4e0a6f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.571348 Jul 26 12:52:04.615026 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 61/119] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:04 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:04.621626 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e1fbf1f0-8417-4883-9aa5-1b2c6bf63a36 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:04.622806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e1fbf1f0-8417-4883-9aa5-1b2c6bf63a36 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:04.630623 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e1fbf1f0-8417-4883-9aa5-1b2c6bf63a36 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:04.631443 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e1fbf1f0-8417-4883-9aa5-1b2c6bf63a36 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:04.632592 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e1fbf1f0-8417-4883-9aa5-1b2c6bf63a36 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:04.633241 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e1fbf1f0-8417-4883-9aa5-1b2c6bf63a36 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:04.798801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-dd6152f8-1da5-4b7e-8483-537a7d57c2f9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:04.808941 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e1fbf1f0-8417-4883-9aa5-1b2c6bf63a36 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:04.825451 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-dd6152f8-1da5-4b7e-8483-537a7d57c2f9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.555197 Jul 26 12:52:04.826253 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 59/120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:04 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:04.833596 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-7f240776-26e3-4eb6-8aaf-e84249d3d68d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:04.834596 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-7f240776-26e3-4eb6-8aaf-e84249d3d68d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:04.841221 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7f240776-26e3-4eb6-8aaf-e84249d3d68d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:04.841568 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e1fbf1f0-8417-4883-9aa5-1b2c6bf63a36 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.224418 Jul 26 12:52:04.841984 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7f240776-26e3-4eb6-8aaf-e84249d3d68d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:04.842200 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 62/121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:04 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:04.842952 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7f240776-26e3-4eb6-8aaf-e84249d3d68d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:04.843482 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7f240776-26e3-4eb6-8aaf-e84249d3d68d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:05.055090 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-7f240776-26e3-4eb6-8aaf-e84249d3d68d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:05.074013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-7f240776-26e3-4eb6-8aaf-e84249d3d68d tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.242270 Jul 26 12:52:05.075767 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 60/122] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:04 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:05.645144 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-fa907796-b017-4b67-8e64-ffd7c13c0df2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:05.645754 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-fa907796-b017-4b67-8e64-ffd7c13c0df2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:05.653206 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fa907796-b017-4b67-8e64-ffd7c13c0df2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:05.653654 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fa907796-b017-4b67-8e64-ffd7c13c0df2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:05.654428 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fa907796-b017-4b67-8e64-ffd7c13c0df2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:05.654864 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fa907796-b017-4b67-8e64-ffd7c13c0df2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:05.850859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d06c412f-2f55-43f9-803c-8df235bebbb7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:05.853758 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d06c412f-2f55-43f9-803c-8df235bebbb7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:05.866310 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d06c412f-2f55-43f9-803c-8df235bebbb7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:05.867329 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d06c412f-2f55-43f9-803c-8df235bebbb7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:05.869500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d06c412f-2f55-43f9-803c-8df235bebbb7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:05.870361 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d06c412f-2f55-43f9-803c-8df235bebbb7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:05.879759 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-fa907796-b017-4b67-8e64-ffd7c13c0df2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:05.900290 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-fa907796-b017-4b67-8e64-ffd7c13c0df2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:05.902609 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-fa907796-b017-4b67-8e64-ffd7c13c0df2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:05.904222 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-fa907796-b017-4b67-8e64-ffd7c13c0df2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.265021 Jul 26 12:52:05.913609 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 63/123] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:05 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:05.920490 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-887b5841-8d36-4982-a5c4-9368b27789eb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:05.921626 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-887b5841-8d36-4982-a5c4-9368b27789eb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:05.929975 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-887b5841-8d36-4982-a5c4-9368b27789eb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:05.930579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-887b5841-8d36-4982-a5c4-9368b27789eb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:05.931795 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-887b5841-8d36-4982-a5c4-9368b27789eb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:05.933679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-887b5841-8d36-4982-a5c4-9368b27789eb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:06.219361 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d06c412f-2f55-43f9-803c-8df235bebbb7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:06.227574 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d06c412f-2f55-43f9-803c-8df235bebbb7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.384934 Jul 26 12:52:06.231314 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 61/124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:05 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:06.241888 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f0b2ecde-1b4f-49bb-8f86-4d10b2e55fc6 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:06.244195 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f0b2ecde-1b4f-49bb-8f86-4d10b2e55fc6 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:06.258674 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f0b2ecde-1b4f-49bb-8f86-4d10b2e55fc6 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:06.264847 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f0b2ecde-1b4f-49bb-8f86-4d10b2e55fc6 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:06.266048 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f0b2ecde-1b4f-49bb-8f86-4d10b2e55fc6 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:06.266683 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f0b2ecde-1b4f-49bb-8f86-4d10b2e55fc6 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:06.337422 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-887b5841-8d36-4982-a5c4-9368b27789eb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:06.346622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-887b5841-8d36-4982-a5c4-9368b27789eb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1321 microversion: 2.1 time: 0.430876 Jul 26 12:52:06.347573 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 64/125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:05 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:06.352986 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-3a421f4a-cfdc-4af0-a619-3956f37dc5a5 req-d2199b94-2efe-4684-8b8f-f0d0e7eab451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13491d52-d823-4b46-9537-93441e1df6e3", "name": "network-vif-plugged", "status": "completed", "tag": "0b6d5dd0-f483-4401-bba0-62699172f404"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:52:06.364159 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-3a421f4a-cfdc-4af0-a619-3956f37dc5a5 req-d2199b94-2efe-4684-8b8f-f0d0e7eab451 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:06.364853 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-3a421f4a-cfdc-4af0-a619-3956f37dc5a5 req-d2199b94-2efe-4684-8b8f-f0d0e7eab451 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:06.379298 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-3a421f4a-cfdc-4af0-a619-3956f37dc5a5 req-d2199b94-2efe-4684-8b8f-f0d0e7eab451 service nova] Creating event network-vif-plugged:0b6d5dd0-f483-4401-bba0-62699172f404 for instance 13491d52-d823-4b46-9537-93441e1df6e3 on hv-cinder-85093 Jul 26 12:52:06.386541 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-3a421f4a-cfdc-4af0-a619-3956f37dc5a5 req-d2199b94-2efe-4684-8b8f-f0d0e7eab451 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037425 Jul 26 12:52:06.387670 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 65/126] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:52:06.566026 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f0b2ecde-1b4f-49bb-8f86-4d10b2e55fc6 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:06.588279 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f0b2ecde-1b4f-49bb-8f86-4d10b2e55fc6 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.354051 Jul 26 12:52:06.612070 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 62/127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:06 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:06.930829 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6b3a4537-9b8e-40b5-8d6b-66c79234c555 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:06.932991 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6b3a4537-9b8e-40b5-8d6b-66c79234c555 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:06.951323 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6b3a4537-9b8e-40b5-8d6b-66c79234c555 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:06.952015 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6b3a4537-9b8e-40b5-8d6b-66c79234c555 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:06.952813 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6b3a4537-9b8e-40b5-8d6b-66c79234c555 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:06.953255 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6b3a4537-9b8e-40b5-8d6b-66c79234c555 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:07.157541 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6b3a4537-9b8e-40b5-8d6b-66c79234c555 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:07.169626 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6b3a4537-9b8e-40b5-8d6b-66c79234c555 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:07.171597 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6b3a4537-9b8e-40b5-8d6b-66c79234c555 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:07.174001 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6b3a4537-9b8e-40b5-8d6b-66c79234c555 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.248523 Jul 26 12:52:07.175213 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 66/128] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:06 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:07.255506 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4fe7c689-dc50-4710-938c-330786240316 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:07.256213 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4fe7c689-dc50-4710-938c-330786240316 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:07.267211 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4fe7c689-dc50-4710-938c-330786240316 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:07.267702 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4fe7c689-dc50-4710-938c-330786240316 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:07.268486 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4fe7c689-dc50-4710-938c-330786240316 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:07.268930 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4fe7c689-dc50-4710-938c-330786240316 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:07.371193 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f34b41d9-56aa-4575-9f3b-332eed5eb56d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:07.371964 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f34b41d9-56aa-4575-9f3b-332eed5eb56d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:07.383420 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f34b41d9-56aa-4575-9f3b-332eed5eb56d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:07.386376 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f34b41d9-56aa-4575-9f3b-332eed5eb56d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:07.387666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f34b41d9-56aa-4575-9f3b-332eed5eb56d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:07.389327 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f34b41d9-56aa-4575-9f3b-332eed5eb56d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:07.467190 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4fe7c689-dc50-4710-938c-330786240316 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:07.477506 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4fe7c689-dc50-4710-938c-330786240316 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.226929 Jul 26 12:52:07.478215 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 63/129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:07 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:07.612467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9ce8d690-bb0e-4967-b584-1762c4f130de tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:07.614115 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9ce8d690-bb0e-4967-b584-1762c4f130de tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:07.622575 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9ce8d690-bb0e-4967-b584-1762c4f130de tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:07.623465 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9ce8d690-bb0e-4967-b584-1762c4f130de tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:07.624450 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9ce8d690-bb0e-4967-b584-1762c4f130de tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:07.625091 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9ce8d690-bb0e-4967-b584-1762c4f130de tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:07.773052 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f34b41d9-56aa-4575-9f3b-332eed5eb56d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:07.782831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f34b41d9-56aa-4575-9f3b-332eed5eb56d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1514 microversion: 2.1 time: 0.417696 Jul 26 12:52:07.783910 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 67/130] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:07 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1514 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:07.804514 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9ce8d690-bb0e-4967-b584-1762c4f130de tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:07.810811 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7f09a8b4-b744-4bfd-a5b1-576acbe75b2c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:52:07.813795 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7f09a8b4-b744-4bfd-a5b1-576acbe75b2c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:07.814763 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=100 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:07.821471 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7f09a8b4-b744-4bfd-a5b1-576acbe75b2c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:07.821686 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9ce8d690-bb0e-4967-b584-1762c4f130de tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.214858 Jul 26 12:52:07.821913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7f09a8b4-b744-4bfd-a5b1-576acbe75b2c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:07.822067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 64/131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:07 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:07.822755 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7f09a8b4-b744-4bfd-a5b1-576acbe75b2c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:07.823299 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7f09a8b4-b744-4bfd-a5b1-576acbe75b2c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:07.887861 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-7f09a8b4-b744-4bfd-a5b1-576acbe75b2c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lazy-loading 'flavor' on Instance uuid 2b250f71-ee8b-4975-b24b-3984e8b02c6b {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:52:08.014089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7f09a8b4-b744-4bfd-a5b1-576acbe75b2c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "POST /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b/action" status: 200 len: 32 microversion: 2.1 time: 0.211668 Jul 26 12:52:08.014749 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 68/132] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 12:52:07 2022] POST /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 12:52:08.024501 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5f25072e-631e-42be-b51f-3eca7e2a63a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:08.025060 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5f25072e-631e-42be-b51f-3eca7e2a63a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:08.031414 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5f25072e-631e-42be-b51f-3eca7e2a63a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:08.032069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5f25072e-631e-42be-b51f-3eca7e2a63a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:08.032836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5f25072e-631e-42be-b51f-3eca7e2a63a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:08.033454 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5f25072e-631e-42be-b51f-3eca7e2a63a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:08.180521 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5f25072e-631e-42be-b51f-3eca7e2a63a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:08.189035 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5f25072e-631e-42be-b51f-3eca7e2a63a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.168509 Jul 26 12:52:08.189769 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 65/133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:08 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:08.206811 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e290c0ff-a9b6-4bd4-8651-7efbf29fb5f0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:08.207624 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e290c0ff-a9b6-4bd4-8651-7efbf29fb5f0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:08.215570 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e290c0ff-a9b6-4bd4-8651-7efbf29fb5f0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:08.216148 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e290c0ff-a9b6-4bd4-8651-7efbf29fb5f0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:08.216926 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e290c0ff-a9b6-4bd4-8651-7efbf29fb5f0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:08.217364 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e290c0ff-a9b6-4bd4-8651-7efbf29fb5f0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:08.221561 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:08.403687 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-b09973f1-b934-4f10-b6e9-3b3636205c9b req-897f4e4f-622f-4ac6-ba2b-b6081ae19ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a767a6a-b160-4f7d-970f-c45ff5bc1566", "name": "network-vif-plugged", "status": "completed", "tag": "34328d9b-7b53-457f-a58d-3371c1433b29"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:52:08.420786 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-b09973f1-b934-4f10-b6e9-3b3636205c9b req-897f4e4f-622f-4ac6-ba2b-b6081ae19ebf service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:08.422689 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-b09973f1-b934-4f10-b6e9-3b3636205c9b req-897f4e4f-622f-4ac6-ba2b-b6081ae19ebf service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:08.423489 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e290c0ff-a9b6-4bd4-8651-7efbf29fb5f0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:08.437256 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e290c0ff-a9b6-4bd4-8651-7efbf29fb5f0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:08.439555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e290c0ff-a9b6-4bd4-8651-7efbf29fb5f0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:08.441123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e290c0ff-a9b6-4bd4-8651-7efbf29fb5f0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.239512 Jul 26 12:52:08.441957 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 69/134] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:08 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:08.451479 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-b09973f1-b934-4f10-b6e9-3b3636205c9b req-897f4e4f-622f-4ac6-ba2b-b6081ae19ebf service nova] Creating event network-vif-plugged:34328d9b-7b53-457f-a58d-3371c1433b29 for instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 on hv-cinder-85093 Jul 26 12:52:08.459586 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-b09973f1-b934-4f10-b6e9-3b3636205c9b req-897f4e4f-622f-4ac6-ba2b-b6081ae19ebf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060093 Jul 26 12:52:08.460185 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 66/135] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:52:08.498687 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8ad09ed7-1d94-4e53-822b-efdb4bf97502 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:08.507175 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8ad09ed7-1d94-4e53-822b-efdb4bf97502 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:08.508069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8ad09ed7-1d94-4e53-822b-efdb4bf97502 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:08.508514 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8ad09ed7-1d94-4e53-822b-efdb4bf97502 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:08.509490 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8ad09ed7-1d94-4e53-822b-efdb4bf97502 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:08.510118 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8ad09ed7-1d94-4e53-822b-efdb4bf97502 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:08.698930 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8ad09ed7-1d94-4e53-822b-efdb4bf97502 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:08.709433 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8ad09ed7-1d94-4e53-822b-efdb4bf97502 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.214759 Jul 26 12:52:08.710092 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 70/136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:08 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:08.843098 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3edfc0b8-b09a-47f8-b9db-ec96924c013e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:08.846343 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3edfc0b8-b09a-47f8-b9db-ec96924c013e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:08.859341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3edfc0b8-b09a-47f8-b9db-ec96924c013e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:08.859899 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3edfc0b8-b09a-47f8-b9db-ec96924c013e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:08.860683 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3edfc0b8-b09a-47f8-b9db-ec96924c013e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:08.861108 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3edfc0b8-b09a-47f8-b9db-ec96924c013e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:09.064782 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3edfc0b8-b09a-47f8-b9db-ec96924c013e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:09.073042 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3edfc0b8-b09a-47f8-b9db-ec96924c013e tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.234189 Jul 26 12:52:09.073720 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 67/137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:08 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:09.210749 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-cd967a43-b215-4615-a67f-0ff7069e02aa tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:09.211399 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-cd967a43-b215-4615-a67f-0ff7069e02aa tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:09.219457 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cd967a43-b215-4615-a67f-0ff7069e02aa tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:09.219862 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cd967a43-b215-4615-a67f-0ff7069e02aa tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:09.220637 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cd967a43-b215-4615-a67f-0ff7069e02aa tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:09.221109 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cd967a43-b215-4615-a67f-0ff7069e02aa tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:09.387185 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-cd967a43-b215-4615-a67f-0ff7069e02aa tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:09.401782 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-cd967a43-b215-4615-a67f-0ff7069e02aa tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.195315 Jul 26 12:52:09.402440 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 71/138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:09 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:09.469908 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e44f653c-f04a-4266-80d3-d5ee16f0abe2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:09.470933 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e44f653c-f04a-4266-80d3-d5ee16f0abe2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:09.477842 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e44f653c-f04a-4266-80d3-d5ee16f0abe2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:09.478292 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e44f653c-f04a-4266-80d3-d5ee16f0abe2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:09.479054 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e44f653c-f04a-4266-80d3-d5ee16f0abe2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:09.479725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e44f653c-f04a-4266-80d3-d5ee16f0abe2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:09.652362 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e44f653c-f04a-4266-80d3-d5ee16f0abe2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:09.661401 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e44f653c-f04a-4266-80d3-d5ee16f0abe2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:09.663322 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e44f653c-f04a-4266-80d3-d5ee16f0abe2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:09.664680 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e44f653c-f04a-4266-80d3-d5ee16f0abe2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.198768 Jul 26 12:52:09.665853 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 68/139] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:09 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:09.735968 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e8115f86-e535-4735-b9aa-b2aad31866ae tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:09.737289 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e8115f86-e535-4735-b9aa-b2aad31866ae tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:09.751612 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e8115f86-e535-4735-b9aa-b2aad31866ae tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:09.751612 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e8115f86-e535-4735-b9aa-b2aad31866ae tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:09.751612 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e8115f86-e535-4735-b9aa-b2aad31866ae tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:09.751612 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e8115f86-e535-4735-b9aa-b2aad31866ae tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:09.913821 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e8115f86-e535-4735-b9aa-b2aad31866ae tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:09.925164 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e8115f86-e535-4735-b9aa-b2aad31866ae tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.199010 Jul 26 12:52:09.940873 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 72/140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:09 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:10.095729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-cdba424c-5230-49ab-80b6-ee553f002204 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:10.097105 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-cdba424c-5230-49ab-80b6-ee553f002204 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:10.105075 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cdba424c-5230-49ab-80b6-ee553f002204 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:10.106497 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cdba424c-5230-49ab-80b6-ee553f002204 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:10.107534 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cdba424c-5230-49ab-80b6-ee553f002204 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:10.108208 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cdba424c-5230-49ab-80b6-ee553f002204 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:10.289756 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-cdba424c-5230-49ab-80b6-ee553f002204 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:10.300388 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-cdba424c-5230-49ab-80b6-ee553f002204 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.209752 Jul 26 12:52:10.300999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 69/141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:10 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:10.425097 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ec4c0313-71d7-4dbf-8961-0106c8843a6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:10.425703 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ec4c0313-71d7-4dbf-8961-0106c8843a6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:10.433891 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ec4c0313-71d7-4dbf-8961-0106c8843a6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:10.434193 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ec4c0313-71d7-4dbf-8961-0106c8843a6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:10.435144 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ec4c0313-71d7-4dbf-8961-0106c8843a6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:10.435971 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ec4c0313-71d7-4dbf-8961-0106c8843a6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:10.690344 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d2302582-124b-41f5-b170-abe7b28576d9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:10.692620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d2302582-124b-41f5-b170-abe7b28576d9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:10.706337 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d2302582-124b-41f5-b170-abe7b28576d9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:10.706959 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d2302582-124b-41f5-b170-abe7b28576d9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:10.713461 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d2302582-124b-41f5-b170-abe7b28576d9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:10.715562 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d2302582-124b-41f5-b170-abe7b28576d9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:11.039996 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ec4c0313-71d7-4dbf-8961-0106c8843a6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:11.052296 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ec4c0313-71d7-4dbf-8961-0106c8843a6e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.633334 Jul 26 12:52:11.053256 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 73/142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:10 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:11.059361 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-da973515-48f9-4626-b9a7-b9c482416623 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:11.060414 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-da973515-48f9-4626-b9a7-b9c482416623 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:11.067568 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-da973515-48f9-4626-b9a7-b9c482416623 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:11.069019 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-da973515-48f9-4626-b9a7-b9c482416623 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:11.070511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-da973515-48f9-4626-b9a7-b9c482416623 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:11.071729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-da973515-48f9-4626-b9a7-b9c482416623 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:11.113390 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d2302582-124b-41f5-b170-abe7b28576d9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:11.125268 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d2302582-124b-41f5-b170-abe7b28576d9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:11.126790 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d2302582-124b-41f5-b170-abe7b28576d9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:11.128044 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d2302582-124b-41f5-b170-abe7b28576d9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.444960 Jul 26 12:52:11.129253 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 70/143] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:10 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:11.324482 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-da973515-48f9-4626-b9a7-b9c482416623 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:11.332465 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-da973515-48f9-4626-b9a7-b9c482416623 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.277798 Jul 26 12:52:11.333038 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 74/144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:11 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:11.340943 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-bfae6d86-2ab8-48ca-97e3-daefd49dccae tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:11.341562 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-bfae6d86-2ab8-48ca-97e3-daefd49dccae tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:11.349274 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bfae6d86-2ab8-48ca-97e3-daefd49dccae tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:11.349903 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bfae6d86-2ab8-48ca-97e3-daefd49dccae tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:11.350682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bfae6d86-2ab8-48ca-97e3-daefd49dccae tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:11.351116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bfae6d86-2ab8-48ca-97e3-daefd49dccae tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:11.679828 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bfae6d86-2ab8-48ca-97e3-daefd49dccae tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:11.692533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-bfae6d86-2ab8-48ca-97e3-daefd49dccae tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1315 microversion: 2.1 time: 0.361731 Jul 26 12:52:11.694412 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 71/145] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:11 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:12.088783 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-79ea85a9-f3ca-404f-adc1-20c5b5d1d3c9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:12.089918 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-79ea85a9-f3ca-404f-adc1-20c5b5d1d3c9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:12.124620 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-79ea85a9-f3ca-404f-adc1-20c5b5d1d3c9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:12.125562 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-79ea85a9-f3ca-404f-adc1-20c5b5d1d3c9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:12.127023 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-79ea85a9-f3ca-404f-adc1-20c5b5d1d3c9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:12.127846 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-79ea85a9-f3ca-404f-adc1-20c5b5d1d3c9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:12.154552 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1613ecda-e4f9-4e5e-92b2-47fe199084d5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:12.158299 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1613ecda-e4f9-4e5e-92b2-47fe199084d5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:12.183462 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1613ecda-e4f9-4e5e-92b2-47fe199084d5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:12.184200 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1613ecda-e4f9-4e5e-92b2-47fe199084d5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:12.192399 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1613ecda-e4f9-4e5e-92b2-47fe199084d5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:12.193892 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1613ecda-e4f9-4e5e-92b2-47fe199084d5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:12.482954 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1613ecda-e4f9-4e5e-92b2-47fe199084d5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:12.497277 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1613ecda-e4f9-4e5e-92b2-47fe199084d5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:12.501302 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1613ecda-e4f9-4e5e-92b2-47fe199084d5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:12.502414 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-79ea85a9-f3ca-404f-adc1-20c5b5d1d3c9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:12.502590 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1613ecda-e4f9-4e5e-92b2-47fe199084d5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.355001 Jul 26 12:52:12.505043 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 72/146] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:12 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:12.518624 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-79ea85a9-f3ca-404f-adc1-20c5b5d1d3c9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.439517 Jul 26 12:52:12.518624 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 75/147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:12 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:12.524427 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-70ea2d33-472c-45aa-af6f-80417a1cc93d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:12.525908 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-70ea2d33-472c-45aa-af6f-80417a1cc93d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:12.544038 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-70ea2d33-472c-45aa-af6f-80417a1cc93d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:12.544787 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-70ea2d33-472c-45aa-af6f-80417a1cc93d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:12.545716 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-70ea2d33-472c-45aa-af6f-80417a1cc93d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:12.546372 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-70ea2d33-472c-45aa-af6f-80417a1cc93d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:12.596565 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-fcaf5ba1-ed2e-4626-a932-2d77bd104abf req-cb5e21a2-7cb6-4d3f-8b1f-ad60c406d106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4", "name": "network-vif-plugged", "status": "completed", "tag": "edf8881f-7a20-4fbe-8846-b9ee12ada969"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:52:12.637391 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-fcaf5ba1-ed2e-4626-a932-2d77bd104abf req-cb5e21a2-7cb6-4d3f-8b1f-ad60c406d106 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:12.637939 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-fcaf5ba1-ed2e-4626-a932-2d77bd104abf req-cb5e21a2-7cb6-4d3f-8b1f-ad60c406d106 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:12.661673 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-fcaf5ba1-ed2e-4626-a932-2d77bd104abf req-cb5e21a2-7cb6-4d3f-8b1f-ad60c406d106 service nova] Creating event network-vif-plugged:edf8881f-7a20-4fbe-8846-b9ee12ada969 for instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 on hv-cinder-85093 Jul 26 12:52:12.674266 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-fcaf5ba1-ed2e-4626-a932-2d77bd104abf req-cb5e21a2-7cb6-4d3f-8b1f-ad60c406d106 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082580 Jul 26 12:52:12.674920 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 73/148] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:52:12.715933 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d4e939f4-bfbc-4e3c-a4f0-edfad111ab0b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:12.716709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d4e939f4-bfbc-4e3c-a4f0-edfad111ab0b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:12.727820 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d4e939f4-bfbc-4e3c-a4f0-edfad111ab0b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:12.730433 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d4e939f4-bfbc-4e3c-a4f0-edfad111ab0b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:12.732963 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d4e939f4-bfbc-4e3c-a4f0-edfad111ab0b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:12.733613 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d4e939f4-bfbc-4e3c-a4f0-edfad111ab0b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:12.825943 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-70ea2d33-472c-45aa-af6f-80417a1cc93d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:12.841924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-70ea2d33-472c-45aa-af6f-80417a1cc93d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.324226 Jul 26 12:52:12.843788 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 76/149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:12 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:12.939490 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d4e939f4-bfbc-4e3c-a4f0-edfad111ab0b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:12.950677 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d4e939f4-bfbc-4e3c-a4f0-edfad111ab0b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1503 microversion: 2.1 time: 0.239821 Jul 26 12:52:12.952452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 74/150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:12 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:13.537049 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f418ee4d-afa2-45a2-9660-8df9578d5a52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:13.538361 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f418ee4d-afa2-45a2-9660-8df9578d5a52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:13.540877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c39d0ce2-9a93-47ac-b12d-76db5d6f97f5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:13.541823 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c39d0ce2-9a93-47ac-b12d-76db5d6f97f5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:13.544974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f418ee4d-afa2-45a2-9660-8df9578d5a52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:13.545753 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f418ee4d-afa2-45a2-9660-8df9578d5a52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:13.546989 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f418ee4d-afa2-45a2-9660-8df9578d5a52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:13.547611 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f418ee4d-afa2-45a2-9660-8df9578d5a52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:13.549479 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=99 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:13.551969 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c39d0ce2-9a93-47ac-b12d-76db5d6f97f5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:13.553497 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c39d0ce2-9a93-47ac-b12d-76db5d6f97f5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:13.555503 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c39d0ce2-9a93-47ac-b12d-76db5d6f97f5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:13.556429 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c39d0ce2-9a93-47ac-b12d-76db5d6f97f5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:13.737927 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f418ee4d-afa2-45a2-9660-8df9578d5a52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:13.741618 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c39d0ce2-9a93-47ac-b12d-76db5d6f97f5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:13.750805 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c39d0ce2-9a93-47ac-b12d-76db5d6f97f5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.216060 Jul 26 12:52:13.751784 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 75/151] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:13 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:13.753264 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f418ee4d-afa2-45a2-9660-8df9578d5a52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:13.754873 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f418ee4d-afa2-45a2-9660-8df9578d5a52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:13.756723 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f418ee4d-afa2-45a2-9660-8df9578d5a52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.223601 Jul 26 12:52:13.757531 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 77/152] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:13 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:13.864537 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c15f2d52-59cf-4c92-aa67-6f8812ed912f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:13.865205 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c15f2d52-59cf-4c92-aa67-6f8812ed912f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:13.871850 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c15f2d52-59cf-4c92-aa67-6f8812ed912f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:13.872520 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c15f2d52-59cf-4c92-aa67-6f8812ed912f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:13.873547 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c15f2d52-59cf-4c92-aa67-6f8812ed912f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:13.875086 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c15f2d52-59cf-4c92-aa67-6f8812ed912f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:14.238744 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c15f2d52-59cf-4c92-aa67-6f8812ed912f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:14.247859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c15f2d52-59cf-4c92-aa67-6f8812ed912f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1368 microversion: 2.1 time: 0.385982 Jul 26 12:52:14.247859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 76/153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:13 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1368 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:14.696931 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-d44746cc-9e5b-4901-9847-5ea52f23a23d req-c2df1b10-279a-4741-bdf9-996f53444786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20220b7e-2897-4f0c-98da-3f352aa39ec2", "name": "network-vif-plugged", "status": "completed", "tag": "32e67b58-c4c4-4a07-b551-08232595ea42"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:52:14.706944 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-d44746cc-9e5b-4901-9847-5ea52f23a23d req-c2df1b10-279a-4741-bdf9-996f53444786 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:14.707652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-d44746cc-9e5b-4901-9847-5ea52f23a23d req-c2df1b10-279a-4741-bdf9-996f53444786 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:14.723185 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-d44746cc-9e5b-4901-9847-5ea52f23a23d req-c2df1b10-279a-4741-bdf9-996f53444786 service nova] Creating event network-vif-plugged:32e67b58-c4c4-4a07-b551-08232595ea42 for instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 on hv-cinder-85093 Jul 26 12:52:14.729493 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-d44746cc-9e5b-4901-9847-5ea52f23a23d req-c2df1b10-279a-4741-bdf9-996f53444786 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038244 Jul 26 12:52:14.730964 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 78/154] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:52:14.774481 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-498e3b01-c903-4ebb-9548-bf1df1543403 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:14.775101 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-498e3b01-c903-4ebb-9548-bf1df1543403 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:14.779783 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c129704f-8cee-4650-ad3e-c348da19c700 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:14.780762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c129704f-8cee-4650-ad3e-c348da19c700 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:14.787092 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-498e3b01-c903-4ebb-9548-bf1df1543403 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:14.787611 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-498e3b01-c903-4ebb-9548-bf1df1543403 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:14.788405 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-498e3b01-c903-4ebb-9548-bf1df1543403 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:14.788893 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-498e3b01-c903-4ebb-9548-bf1df1543403 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:14.789888 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c129704f-8cee-4650-ad3e-c348da19c700 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:14.790436 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c129704f-8cee-4650-ad3e-c348da19c700 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:14.791883 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c129704f-8cee-4650-ad3e-c348da19c700 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:14.792530 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c129704f-8cee-4650-ad3e-c348da19c700 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:14.990771 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-498e3b01-c903-4ebb-9548-bf1df1543403 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:15.001235 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-498e3b01-c903-4ebb-9548-bf1df1543403 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.232601 Jul 26 12:52:15.012647 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 77/155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:14 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:15.042570 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-69bac543-947e-4888-bc1b-8076304868f8 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7d57798-9803-48bb-b472-d050bfc70bf7"}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:52:15.047801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-69bac543-947e-4888-bc1b-8076304868f8 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:15.062949 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69bac543-947e-4888-bc1b-8076304868f8 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:15.064917 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69bac543-947e-4888-bc1b-8076304868f8 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:15.066555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69bac543-947e-4888-bc1b-8076304868f8 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:15.067512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69bac543-947e-4888-bc1b-8076304868f8 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:15.069089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c129704f-8cee-4650-ad3e-c348da19c700 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:15.081321 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c129704f-8cee-4650-ad3e-c348da19c700 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:15.085663 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c129704f-8cee-4650-ad3e-c348da19c700 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:15.089882 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c129704f-8cee-4650-ad3e-c348da19c700 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.314078 Jul 26 12:52:15.090515 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 79/156] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:14 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:15.271163 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9675b859-de8d-4351-b702-240dcfb0dec0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:15.273058 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-9675b859-de8d-4351-b702-240dcfb0dec0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:15.286593 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9675b859-de8d-4351-b702-240dcfb0dec0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:15.288495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9675b859-de8d-4351-b702-240dcfb0dec0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:15.290438 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9675b859-de8d-4351-b702-240dcfb0dec0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:15.291080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9675b859-de8d-4351-b702-240dcfb0dec0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:15.524365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-9675b859-de8d-4351-b702-240dcfb0dec0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:15.532495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9675b859-de8d-4351-b702-240dcfb0dec0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1559 microversion: 2.1 time: 0.265636 Jul 26 12:52:15.533079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 80/157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:15 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1559 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:15.554921 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-71967f77-be34-467f-b54f-22092e8c4827 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:15.555349 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-71967f77-be34-467f-b54f-22092e8c4827 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:15.561695 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-71967f77-be34-467f-b54f-22092e8c4827 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:15.562153 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-71967f77-be34-467f-b54f-22092e8c4827 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:15.562942 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-71967f77-be34-467f-b54f-22092e8c4827 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:15.563414 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-71967f77-be34-467f-b54f-22092e8c4827 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:15.650459 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-71967f77-be34-467f-b54f-22092e8c4827 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100133 Jul 26 12:52:15.658908 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 81/158] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Jul 26 12:52:15 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:52:15.789944 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-69bac543-947e-4888-bc1b-8076304868f8 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "POST /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752638 Jul 26 12:52:15.790551 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 78/159] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 12:52:15 2022] POST /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:52:16.024873 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b5de50b4-4540-4700-9627-2fca7a12cf9f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:16.025486 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b5de50b4-4540-4700-9627-2fca7a12cf9f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:16.035593 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b5de50b4-4540-4700-9627-2fca7a12cf9f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:16.036080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b5de50b4-4540-4700-9627-2fca7a12cf9f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:16.037598 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b5de50b4-4540-4700-9627-2fca7a12cf9f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:16.038045 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b5de50b4-4540-4700-9627-2fca7a12cf9f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:16.117906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-462fbb7f-283d-491b-9764-31542f96bc05 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:16.118609 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-462fbb7f-283d-491b-9764-31542f96bc05 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:16.126766 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-462fbb7f-283d-491b-9764-31542f96bc05 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:16.127445 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-462fbb7f-283d-491b-9764-31542f96bc05 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:16.128398 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-462fbb7f-283d-491b-9764-31542f96bc05 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:16.128975 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-462fbb7f-283d-491b-9764-31542f96bc05 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:16.356929 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-462fbb7f-283d-491b-9764-31542f96bc05 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:16.373910 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-462fbb7f-283d-491b-9764-31542f96bc05 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:16.375460 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-462fbb7f-283d-491b-9764-31542f96bc05 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:16.377838 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-462fbb7f-283d-491b-9764-31542f96bc05 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.264843 Jul 26 12:52:16.378406 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 79/160] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:16 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:52:16.471919 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-b5de50b4-4540-4700-9627-2fca7a12cf9f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:16.480974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b5de50b4-4540-4700-9627-2fca7a12cf9f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.460385 Jul 26 12:52:16.481783 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 82/161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:16 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:17.387008 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-1be346cb-d682-48d8-9b13-c3bd92fdece8 req-089c8c27-2777-453c-9946-144f2f9c5c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4", "tag": "edf8881f-7a20-4fbe-8846-b9ee12ada969"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:52:17.398357 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-1be346cb-d682-48d8-9b13-c3bd92fdece8 req-089c8c27-2777-453c-9946-144f2f9c5c96 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:17.398357 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-1be346cb-d682-48d8-9b13-c3bd92fdece8 req-089c8c27-2777-453c-9946-144f2f9c5c96 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:17.403856 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3a8e9494-4b83-45bd-ab64-72d9828f875a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:17.404462 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3a8e9494-4b83-45bd-ab64-72d9828f875a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:17.414736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a8e9494-4b83-45bd-ab64-72d9828f875a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:17.416163 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a8e9494-4b83-45bd-ab64-72d9828f875a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:17.418090 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a8e9494-4b83-45bd-ab64-72d9828f875a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:17.419876 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a8e9494-4b83-45bd-ab64-72d9828f875a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:17.426816 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-1be346cb-d682-48d8-9b13-c3bd92fdece8 req-089c8c27-2777-453c-9946-144f2f9c5c96 service nova] Creating event network-changed:edf8881f-7a20-4fbe-8846-b9ee12ada969 for instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 on hv-cinder-85093 Jul 26 12:52:17.444949 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-1be346cb-d682-48d8-9b13-c3bd92fdece8 req-089c8c27-2777-453c-9946-144f2f9c5c96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061071 Jul 26 12:52:17.446255 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 80/162] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:52:17.508328 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-93838754-cc53-42b3-bdc4-db9e7f6b1f89 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:17.509319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-93838754-cc53-42b3-bdc4-db9e7f6b1f89 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:17.547837 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-93838754-cc53-42b3-bdc4-db9e7f6b1f89 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:17.548870 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-93838754-cc53-42b3-bdc4-db9e7f6b1f89 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:17.549984 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-93838754-cc53-42b3-bdc4-db9e7f6b1f89 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:17.550648 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-93838754-cc53-42b3-bdc4-db9e7f6b1f89 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:17.686571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3a8e9494-4b83-45bd-ab64-72d9828f875a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:17.700641 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3a8e9494-4b83-45bd-ab64-72d9828f875a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:17.702437 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3a8e9494-4b83-45bd-ab64-72d9828f875a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:17.703583 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3a8e9494-4b83-45bd-ab64-72d9828f875a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1407 microversion: 2.20 time: 0.303603 Jul 26 12:52:17.704179 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 83/163] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:17 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:17.836985 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-93838754-cc53-42b3-bdc4-db9e7f6b1f89 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:17.848418 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-93838754-cc53-42b3-bdc4-db9e7f6b1f89 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.348319 Jul 26 12:52:17.850190 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 81/164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:17 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:18.728859 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-74dea2dc-130c-4ab2-9e1e-97c1ad355ca9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:18.730095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-74dea2dc-130c-4ab2-9e1e-97c1ad355ca9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:18.738651 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-74dea2dc-130c-4ab2-9e1e-97c1ad355ca9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:18.739531 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-74dea2dc-130c-4ab2-9e1e-97c1ad355ca9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:18.741478 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-74dea2dc-130c-4ab2-9e1e-97c1ad355ca9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:18.742025 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-74dea2dc-130c-4ab2-9e1e-97c1ad355ca9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:18.878039 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-217215db-239e-4622-9af8-6070d8a96196 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:18.878824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-217215db-239e-4622-9af8-6070d8a96196 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:18.889464 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-217215db-239e-4622-9af8-6070d8a96196 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:18.889923 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-217215db-239e-4622-9af8-6070d8a96196 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:18.891287 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-217215db-239e-4622-9af8-6070d8a96196 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:18.891966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-217215db-239e-4622-9af8-6070d8a96196 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:18.919625 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:18.957775 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-74dea2dc-130c-4ab2-9e1e-97c1ad355ca9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:18.969557 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-74dea2dc-130c-4ab2-9e1e-97c1ad355ca9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:18.972803 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-74dea2dc-130c-4ab2-9e1e-97c1ad355ca9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:18.976617 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-74dea2dc-130c-4ab2-9e1e-97c1ad355ca9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1600 microversion: 2.20 time: 0.252273 Jul 26 12:52:18.977213 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 84/165] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:52:18 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1600 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:52:19.014672 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f1c7a879-91e4-4a35-a70f-0358c3cf6e41 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:19.015263 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f1c7a879-91e4-4a35-a70f-0358c3cf6e41 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:19.031300 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f1c7a879-91e4-4a35-a70f-0358c3cf6e41 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:19.031782 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f1c7a879-91e4-4a35-a70f-0358c3cf6e41 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:19.034090 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f1c7a879-91e4-4a35-a70f-0358c3cf6e41 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:19.035411 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f1c7a879-91e4-4a35-a70f-0358c3cf6e41 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:19.247616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f1c7a879-91e4-4a35-a70f-0358c3cf6e41 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.239269 Jul 26 12:52:19.249285 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 85/166] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Jul 26 12:52:19 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/os-interface => generated 285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 12:52:19.266052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-217215db-239e-4622-9af8-6070d8a96196 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:19.279919 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-217215db-239e-4622-9af8-6070d8a96196 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.410659 Jul 26 12:52:19.280980 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 82/167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:18 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:20.301297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a44e42ae-5283-4271-9ece-d69936801f55 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:20.301947 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-a44e42ae-5283-4271-9ece-d69936801f55 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:20.309032 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a44e42ae-5283-4271-9ece-d69936801f55 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:20.328647 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a44e42ae-5283-4271-9ece-d69936801f55 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:20.329793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a44e42ae-5283-4271-9ece-d69936801f55 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:20.331709 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a44e42ae-5283-4271-9ece-d69936801f55 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:20.572952 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-65e7e852-f455-4f80-9492-cea3472e1425 req-70a69a3e-20a2-46ca-bb2f-e431b306f39c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20220b7e-2897-4f0c-98da-3f352aa39ec2", "tag": "32e67b58-c4c4-4a07-b551-08232595ea42"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:52:20.587895 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-65e7e852-f455-4f80-9492-cea3472e1425 req-70a69a3e-20a2-46ca-bb2f-e431b306f39c service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:20.591895 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-65e7e852-f455-4f80-9492-cea3472e1425 req-70a69a3e-20a2-46ca-bb2f-e431b306f39c service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:20.597707 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-a44e42ae-5283-4271-9ece-d69936801f55 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:20.606272 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-65e7e852-f455-4f80-9492-cea3472e1425 req-70a69a3e-20a2-46ca-bb2f-e431b306f39c service nova] Creating event network-changed:32e67b58-c4c4-4a07-b551-08232595ea42 for instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 on hv-cinder-85093 Jul 26 12:52:20.608332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a44e42ae-5283-4271-9ece-d69936801f55 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.310997 Jul 26 12:52:20.609671 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 86/168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:20 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:20.612661 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-65e7e852-f455-4f80-9492-cea3472e1425 req-70a69a3e-20a2-46ca-bb2f-e431b306f39c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045785 Jul 26 12:52:20.613751 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 83/169] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:52:21.632984 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0d431325-32de-4f0f-98cf-1517886ba429 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:21.634480 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0d431325-32de-4f0f-98cf-1517886ba429 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:21.647592 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0d431325-32de-4f0f-98cf-1517886ba429 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:21.649457 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0d431325-32de-4f0f-98cf-1517886ba429 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:21.652035 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0d431325-32de-4f0f-98cf-1517886ba429 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:21.652890 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0d431325-32de-4f0f-98cf-1517886ba429 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:21.665471 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=100 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:21.864337 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0d431325-32de-4f0f-98cf-1517886ba429 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:21.874266 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0d431325-32de-4f0f-98cf-1517886ba429 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.248493 Jul 26 12:52:21.874846 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 87/170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:21 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:22.910226 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-cd8859dc-935c-4d83-9f85-c875028fcaff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:22.910226 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-cd8859dc-935c-4d83-9f85-c875028fcaff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:22.930260 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cd8859dc-935c-4d83-9f85-c875028fcaff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:22.931837 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cd8859dc-935c-4d83-9f85-c875028fcaff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:22.932883 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cd8859dc-935c-4d83-9f85-c875028fcaff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:22.934298 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cd8859dc-935c-4d83-9f85-c875028fcaff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:23.142699 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-cd8859dc-935c-4d83-9f85-c875028fcaff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:23.154721 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-cd8859dc-935c-4d83-9f85-c875028fcaff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.251836 Jul 26 12:52:23.155880 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 84/171] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:22 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:24.183971 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a5ae9426-074f-4433-a12f-53b5c334e91b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:24.183971 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-a5ae9426-074f-4433-a12f-53b5c334e91b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:24.183971 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=93 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:24.186187 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a5ae9426-074f-4433-a12f-53b5c334e91b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:24.186674 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a5ae9426-074f-4433-a12f-53b5c334e91b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:24.187404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a5ae9426-074f-4433-a12f-53b5c334e91b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:24.188060 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a5ae9426-074f-4433-a12f-53b5c334e91b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:24.325963 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-a5ae9426-074f-4433-a12f-53b5c334e91b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:24.334168 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a5ae9426-074f-4433-a12f-53b5c334e91b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.160528 Jul 26 12:52:24.334792 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 88/172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:24 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:25.355729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-578701e5-b6da-4d9a-9dc6-0697a55189ce tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:25.356281 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-578701e5-b6da-4d9a-9dc6-0697a55189ce tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:25.362808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-578701e5-b6da-4d9a-9dc6-0697a55189ce tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:25.363251 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-578701e5-b6da-4d9a-9dc6-0697a55189ce tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:25.364043 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-578701e5-b6da-4d9a-9dc6-0697a55189ce tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:25.364478 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-578701e5-b6da-4d9a-9dc6-0697a55189ce tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:25.496263 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-578701e5-b6da-4d9a-9dc6-0697a55189ce tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:25.504160 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-578701e5-b6da-4d9a-9dc6-0697a55189ce tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.152309 Jul 26 12:52:25.504736 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 85/173] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:25 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:26.526691 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c1ab6fcd-ee6f-4ebc-8d8d-ed7bff645b22 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:26.527407 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c1ab6fcd-ee6f-4ebc-8d8d-ed7bff645b22 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:26.533999 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c1ab6fcd-ee6f-4ebc-8d8d-ed7bff645b22 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:26.534519 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c1ab6fcd-ee6f-4ebc-8d8d-ed7bff645b22 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:26.535292 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c1ab6fcd-ee6f-4ebc-8d8d-ed7bff645b22 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:26.535755 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c1ab6fcd-ee6f-4ebc-8d8d-ed7bff645b22 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:26.666048 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c1ab6fcd-ee6f-4ebc-8d8d-ed7bff645b22 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:26.673497 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c1ab6fcd-ee6f-4ebc-8d8d-ed7bff645b22 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.150801 Jul 26 12:52:26.674065 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 89/174] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:26 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:27.695427 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-07b2cc62-d984-4df6-a475-ad2a1df7461e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:27.696254 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-07b2cc62-d984-4df6-a475-ad2a1df7461e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:27.705915 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-07b2cc62-d984-4df6-a475-ad2a1df7461e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:27.706316 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-07b2cc62-d984-4df6-a475-ad2a1df7461e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:27.707272 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-07b2cc62-d984-4df6-a475-ad2a1df7461e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:27.707740 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-07b2cc62-d984-4df6-a475-ad2a1df7461e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:27.872214 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-07b2cc62-d984-4df6-a475-ad2a1df7461e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:27.885097 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-07b2cc62-d984-4df6-a475-ad2a1df7461e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.193924 Jul 26 12:52:27.885839 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 86/175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:27 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:28.075900 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b674b23c-9597-4a3a-ad38-a9e5bc9e5508 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:28.077159 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b674b23c-9597-4a3a-ad38-a9e5bc9e5508 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:28.083428 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b674b23c-9597-4a3a-ad38-a9e5bc9e5508 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:28.084009 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b674b23c-9597-4a3a-ad38-a9e5bc9e5508 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:28.084775 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b674b23c-9597-4a3a-ad38-a9e5bc9e5508 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:28.085426 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b674b23c-9597-4a3a-ad38-a9e5bc9e5508 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:28.111104 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b674b23c-9597-4a3a-ad38-a9e5bc9e5508 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Going to try to terminate instance {{(pid=129308) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:52:28.201830 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b674b23c-9597-4a3a-ad38-a9e5bc9e5508 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "DELETE /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 204 len: 0 microversion: 2.1 time: 0.129574 Jul 26 12:52:28.202409 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 90/176] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:52:28 2022] DELETE /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:52:28.211037 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8da4a354-cfc0-431d-b7f2-c30fd0579285 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:28.211680 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8da4a354-cfc0-431d-b7f2-c30fd0579285 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:28.230272 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8da4a354-cfc0-431d-b7f2-c30fd0579285 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:28.231111 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8da4a354-cfc0-431d-b7f2-c30fd0579285 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:28.231934 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8da4a354-cfc0-431d-b7f2-c30fd0579285 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:28.234168 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8da4a354-cfc0-431d-b7f2-c30fd0579285 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:28.380204 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8da4a354-cfc0-431d-b7f2-c30fd0579285 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:28.389923 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8da4a354-cfc0-431d-b7f2-c30fd0579285 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1555 microversion: 2.1 time: 0.183100 Jul 26 12:52:28.391063 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 87/177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:28 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1555 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:28.908805 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-424b8dc5-22e8-4c0f-950c-891a8d6264e4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:28.909883 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-424b8dc5-22e8-4c0f-950c-891a8d6264e4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:28.917401 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-424b8dc5-22e8-4c0f-950c-891a8d6264e4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:28.917962 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-424b8dc5-22e8-4c0f-950c-891a8d6264e4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:28.918845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-424b8dc5-22e8-4c0f-950c-891a8d6264e4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:28.919369 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-424b8dc5-22e8-4c0f-950c-891a8d6264e4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:29.075669 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-424b8dc5-22e8-4c0f-950c-891a8d6264e4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:29.084576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-424b8dc5-22e8-4c0f-950c-891a8d6264e4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.179905 Jul 26 12:52:29.087939 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 91/178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:28 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:29.415006 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3b2356d1-3928-4ee9-9ea2-520ee5d5999b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:29.415672 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3b2356d1-3928-4ee9-9ea2-520ee5d5999b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:29.422884 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3b2356d1-3928-4ee9-9ea2-520ee5d5999b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:29.423331 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3b2356d1-3928-4ee9-9ea2-520ee5d5999b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:29.424299 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3b2356d1-3928-4ee9-9ea2-520ee5d5999b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:29.424726 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3b2356d1-3928-4ee9-9ea2-520ee5d5999b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:29.600568 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3b2356d1-3928-4ee9-9ea2-520ee5d5999b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:29.609427 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3b2356d1-3928-4ee9-9ea2-520ee5d5999b tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1555 microversion: 2.1 time: 0.199211 Jul 26 12:52:29.610257 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 88/179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:29 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1555 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:30.107014 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1cacf05c-9416-46a9-8d48-c8eb3608a873 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:30.108320 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1cacf05c-9416-46a9-8d48-c8eb3608a873 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:30.116670 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1cacf05c-9416-46a9-8d48-c8eb3608a873 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:30.117648 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1cacf05c-9416-46a9-8d48-c8eb3608a873 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:30.118928 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1cacf05c-9416-46a9-8d48-c8eb3608a873 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:30.119834 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1cacf05c-9416-46a9-8d48-c8eb3608a873 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:30.548559 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1cacf05c-9416-46a9-8d48-c8eb3608a873 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:30.560067 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1cacf05c-9416-46a9-8d48-c8eb3608a873 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.457176 Jul 26 12:52:30.560933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 92/180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:30 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:30.630616 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-939c5577-52c5-4b18-9dc3-64bd39b37617 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:30.631689 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-939c5577-52c5-4b18-9dc3-64bd39b37617 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:30.639698 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-939c5577-52c5-4b18-9dc3-64bd39b37617 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:30.640149 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-939c5577-52c5-4b18-9dc3-64bd39b37617 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:30.640926 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-939c5577-52c5-4b18-9dc3-64bd39b37617 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:30.641361 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-939c5577-52c5-4b18-9dc3-64bd39b37617 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:31.108715 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-939c5577-52c5-4b18-9dc3-64bd39b37617 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:31.120852 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-939c5577-52c5-4b18-9dc3-64bd39b37617 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1555 microversion: 2.1 time: 0.494048 Jul 26 12:52:31.122230 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 89/181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:30 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1555 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:31.438934 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-5a83f657-3939-44db-9246-ad471b492836 req-cd81bfac-d6fb-4efe-b6f9-e6c866a099ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13491d52-d823-4b46-9537-93441e1df6e3", "name": "network-vif-deleted", "tag": "0b6d5dd0-f483-4401-bba0-62699172f404"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:52:31.449157 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-5a83f657-3939-44db-9246-ad471b492836 req-cd81bfac-d6fb-4efe-b6f9-e6c866a099ab service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:31.449590 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-5a83f657-3939-44db-9246-ad471b492836 req-cd81bfac-d6fb-4efe-b6f9-e6c866a099ab service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:31.463462 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-5a83f657-3939-44db-9246-ad471b492836 req-cd81bfac-d6fb-4efe-b6f9-e6c866a099ab service nova] Creating event network-vif-deleted:0b6d5dd0-f483-4401-bba0-62699172f404 for instance 13491d52-d823-4b46-9537-93441e1df6e3 on hv-cinder-85093 Jul 26 12:52:31.469041 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-5a83f657-3939-44db-9246-ad471b492836 req-cd81bfac-d6fb-4efe-b6f9-e6c866a099ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033289 Jul 26 12:52:31.472447 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 93/182] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:52:31.581979 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-94b2ae0d-f16b-4364-979a-b87b176636d9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:31.582718 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-94b2ae0d-f16b-4364-979a-b87b176636d9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:31.589190 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-94b2ae0d-f16b-4364-979a-b87b176636d9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:31.589640 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-94b2ae0d-f16b-4364-979a-b87b176636d9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:31.590386 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-94b2ae0d-f16b-4364-979a-b87b176636d9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:31.590813 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-94b2ae0d-f16b-4364-979a-b87b176636d9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:31.749332 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-94b2ae0d-f16b-4364-979a-b87b176636d9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:31.757606 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-94b2ae0d-f16b-4364-979a-b87b176636d9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.179429 Jul 26 12:52:31.758406 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 90/183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:31 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:32.145912 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-669ccc12-2939-4a29-9676-9575360c85a5 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:32.147127 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-669ccc12-2939-4a29-9676-9575360c85a5 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:32.153773 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-669ccc12-2939-4a29-9676-9575360c85a5 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:32.154218 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-669ccc12-2939-4a29-9676-9575360c85a5 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:32.155058 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-669ccc12-2939-4a29-9676-9575360c85a5 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:32.155487 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-669ccc12-2939-4a29-9676-9575360c85a5 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:32.188515 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-669ccc12-2939-4a29-9676-9575360c85a5 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:32.189157 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-669ccc12-2939-4a29-9676-9575360c85a5 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:32.189860 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-669ccc12-2939-4a29-9676-9575360c85a5 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lazy-loading 'fault' on Instance uuid 13491d52-d823-4b46-9537-93441e1df6e3 {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:52:32.292511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-669ccc12-2939-4a29-9676-9575360c85a5 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4ed2f2f6994ae2bb00d5a502715b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f35a4b7696f4cdfbb6e6b316352c022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:32.311496 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-669ccc12-2939-4a29-9676-9575360c85a5 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 200 len: 1351 microversion: 2.1 time: 0.169712 Jul 26 12:52:32.312923 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 94/184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:32 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 1351 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:32.779081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5754fc9b-5c3d-4f8c-bc72-9d7d04ab4f7b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:32.779683 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5754fc9b-5c3d-4f8c-bc72-9d7d04ab4f7b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:32.786148 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5754fc9b-5c3d-4f8c-bc72-9d7d04ab4f7b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:32.787287 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5754fc9b-5c3d-4f8c-bc72-9d7d04ab4f7b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:32.788097 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5754fc9b-5c3d-4f8c-bc72-9d7d04ab4f7b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:32.788535 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5754fc9b-5c3d-4f8c-bc72-9d7d04ab4f7b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:33.036499 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5754fc9b-5c3d-4f8c-bc72-9d7d04ab4f7b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:33.046250 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5754fc9b-5c3d-4f8c-bc72-9d7d04ab4f7b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.270175 Jul 26 12:52:33.047035 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 91/185] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:32 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:33.333826 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5a98264d-8d12-4a0a-963f-842c202bf1ed tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:33.334935 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-5a98264d-8d12-4a0a-963f-842c202bf1ed tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:33.343305 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a98264d-8d12-4a0a-963f-842c202bf1ed tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:33.343790 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a98264d-8d12-4a0a-963f-842c202bf1ed tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:33.346118 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a98264d-8d12-4a0a-963f-842c202bf1ed tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:33.346721 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a98264d-8d12-4a0a-963f-842c202bf1ed tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:33.367111 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-5a98264d-8d12-4a0a-963f-842c202bf1ed tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] HTTP exception thrown: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5a98264d-8d12-4a0a-963f-842c202bf1ed tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Request method failure captured: Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 HTTP/1.1 Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-NRKJWhcWGUIhuLosalr6THTJxVylawMCOuMtvpqLjV49ypZJaeDqCQMH1pU0s2k7HvGwOhMG22sqiDZWhMJyeW2ZBARO70UJpJkGS5uI1Nr9rK3moeIjqqr1Gqi7irBnpcLKc899CxrBaZHW309PHedGShqoZzl7UW6xgSN5keRTo Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: 0f35a4b7696f4cdfbb6e6b316352c022 Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-DeleteServersTestJSON-1791744737 Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:52:33.372385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:52:33.374165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f35a4b7696f4cdfbb6e6b316352c022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f35a4b7696f4cdfbb6e6b316352c022", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f35a4b7696f4cdfbb6e6b316352c022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f35a4b7696f4cdfbb6e6b316352c022"}]}] Jul 26 12:52:33.374165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-DeleteServersTestJSON-1791744737 Jul 26 12:52:33.374165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: 0f35a4b7696f4cdfbb6e6b316352c022 Jul 26 12:52:33.374165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-DeleteServersTestJSON-1791744737 Jul 26 12:52:33.374165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-DeleteServersTestJSON-1791744737-project Jul 26 12:52:33.374165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:52:33.374165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:52:33.374165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 7c4ed2f2f6994ae2bb00d5a502715b4f Jul 26 12:52:33.374165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-DeleteServersTestJSON-1791744737-project Jul 26 12:52:33.374165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:52:33.374165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:33.374165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '13491d52-d823-4b46-9537-93441e1df6e3'} Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:52:33.374988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:33.377063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:52:33.378346 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5a98264d-8d12-4a0a-963f-842c202bf1ed tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Returning 404 to user: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:52:33.379244 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-5a98264d-8d12-4a0a-963f-842c202bf1ed tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 404 len: 111 microversion: 2.1 time: 0.049277 Jul 26 12:52:33.379847 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 95/186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:33 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:52:33.509919 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f8a339ce-82b2-4757-8e4e-00e5d7935a49 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:33.513141 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f8a339ce-82b2-4757-8e4e-00e5d7935a49 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:33.521371 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f8a339ce-82b2-4757-8e4e-00e5d7935a49 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:33.522162 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f8a339ce-82b2-4757-8e4e-00e5d7935a49 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:33.523006 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f8a339ce-82b2-4757-8e4e-00e5d7935a49 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:33.523604 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f8a339ce-82b2-4757-8e4e-00e5d7935a49 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:33.542173 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-f8a339ce-82b2-4757-8e4e-00e5d7935a49 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] HTTP exception thrown: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f8a339ce-82b2-4757-8e4e-00e5d7935a49 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Request method failure captured: Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3/os-volume_attachments HTTP/1.1 Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NRKJWhcWGUIhuLosalr6THTJxVylawMCOuMtvpqLjV49ypZJaeDqCQMH1pU0s2k7HvGwOhMG22sqiDZWhMJyeW2ZBARO70UJpJkGS5uI1Nr9rK3moeIjqqr1Gqi7irBnpcLKc899CxrBaZHW309PHedGShqoZzl7UW6xgSN5keRTo Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 0f35a4b7696f4cdfbb6e6b316352c022 Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-DeleteServersTestJSON-1791744737 Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:52:33.546845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:52:33.548306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f35a4b7696f4cdfbb6e6b316352c022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f35a4b7696f4cdfbb6e6b316352c022", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f35a4b7696f4cdfbb6e6b316352c022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f35a4b7696f4cdfbb6e6b316352c022"}]}] Jul 26 12:52:33.548306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-DeleteServersTestJSON-1791744737 Jul 26 12:52:33.548306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 0f35a4b7696f4cdfbb6e6b316352c022 Jul 26 12:52:33.548306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-DeleteServersTestJSON-1791744737 Jul 26 12:52:33.548306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-DeleteServersTestJSON-1791744737-project Jul 26 12:52:33.548306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:52:33.548306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:52:33.548306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 7c4ed2f2f6994ae2bb00d5a502715b4f Jul 26 12:52:33.548306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-DeleteServersTestJSON-1791744737-project Jul 26 12:52:33.548306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:52:33.548306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:33.548306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'server_id': '13491d52-d823-4b46-9537-93441e1df6e3'} Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:52:33.549102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:33.550511 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:52:33.553134 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f8a339ce-82b2-4757-8e4e-00e5d7935a49 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Returning 404 to user: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:52:33.554510 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f8a339ce-82b2-4757-8e4e-00e5d7935a49 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052735 Jul 26 12:52:33.560064 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 92/187] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:52:33 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:52:34.068864 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-fde1e3b4-6b19-4c2e-b566-f83a1321b9a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:34.069710 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-fde1e3b4-6b19-4c2e-b566-f83a1321b9a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:34.076241 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fde1e3b4-6b19-4c2e-b566-f83a1321b9a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:34.076779 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fde1e3b4-6b19-4c2e-b566-f83a1321b9a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:34.077605 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fde1e3b4-6b19-4c2e-b566-f83a1321b9a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:34.078047 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fde1e3b4-6b19-4c2e-b566-f83a1321b9a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:34.312936 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-fde1e3b4-6b19-4c2e-b566-f83a1321b9a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:34.321750 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-fde1e3b4-6b19-4c2e-b566-f83a1321b9a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.258074 Jul 26 12:52:34.322421 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 96/188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:34 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:35.342655 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3f593d8c-1d3c-4e41-abe3-d3b701190a68 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:35.343280 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3f593d8c-1d3c-4e41-abe3-d3b701190a68 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:35.350048 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f593d8c-1d3c-4e41-abe3-d3b701190a68 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:35.350496 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f593d8c-1d3c-4e41-abe3-d3b701190a68 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:35.351253 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f593d8c-1d3c-4e41-abe3-d3b701190a68 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:35.351849 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f593d8c-1d3c-4e41-abe3-d3b701190a68 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:35.503064 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3f593d8c-1d3c-4e41-abe3-d3b701190a68 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:35.512599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3f593d8c-1d3c-4e41-abe3-d3b701190a68 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.173702 Jul 26 12:52:35.513173 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 93/189] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:35 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:36.539387 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-05f98cc5-b801-406a-b41f-d8a485a9832e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:36.540036 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-05f98cc5-b801-406a-b41f-d8a485a9832e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:36.549193 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-05f98cc5-b801-406a-b41f-d8a485a9832e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:36.549660 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-05f98cc5-b801-406a-b41f-d8a485a9832e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:36.550486 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-05f98cc5-b801-406a-b41f-d8a485a9832e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:36.551012 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-05f98cc5-b801-406a-b41f-d8a485a9832e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:36.715427 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-05f98cc5-b801-406a-b41f-d8a485a9832e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:36.723436 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-05f98cc5-b801-406a-b41f-d8a485a9832e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.189068 Jul 26 12:52:36.733089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 97/190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:36 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:36.933286 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8c4a61ce-1320-4cb2-b5f1-0980b8775307 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:36.933846 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8c4a61ce-1320-4cb2-b5f1-0980b8775307 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:36.941580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8c4a61ce-1320-4cb2-b5f1-0980b8775307 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:36.942029 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8c4a61ce-1320-4cb2-b5f1-0980b8775307 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:36.942793 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8c4a61ce-1320-4cb2-b5f1-0980b8775307 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:36.943227 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8c4a61ce-1320-4cb2-b5f1-0980b8775307 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:36.958012 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-8c4a61ce-1320-4cb2-b5f1-0980b8775307 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] HTTP exception thrown: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8c4a61ce-1320-4cb2-b5f1-0980b8775307 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Request method failure captured: Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: DELETE /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 HTTP/1.1 Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NRKJWhcWGUIhuLosalr6THTJxVylawMCOuMtvpqLjV49ypZJaeDqCQMH1pU0s2k7HvGwOhMG22sqiDZWhMJyeW2ZBARO70UJpJkGS5uI1Nr9rK3moeIjqqr1Gqi7irBnpcLKc899CxrBaZHW309PHedGShqoZzl7UW6xgSN5keRTo Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 0f35a4b7696f4cdfbb6e6b316352c022 Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-DeleteServersTestJSON-1791744737 Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:52:36.960844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:52:36.963989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f35a4b7696f4cdfbb6e6b316352c022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f35a4b7696f4cdfbb6e6b316352c022", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f35a4b7696f4cdfbb6e6b316352c022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f35a4b7696f4cdfbb6e6b316352c022"}]}] Jul 26 12:52:36.963989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-DeleteServersTestJSON-1791744737 Jul 26 12:52:36.963989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 0f35a4b7696f4cdfbb6e6b316352c022 Jul 26 12:52:36.963989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-DeleteServersTestJSON-1791744737 Jul 26 12:52:36.963989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-DeleteServersTestJSON-1791744737-project Jul 26 12:52:36.963989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:52:36.963989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:52:36.963989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 7c4ed2f2f6994ae2bb00d5a502715b4f Jul 26 12:52:36.963989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-DeleteServersTestJSON-1791744737-project Jul 26 12:52:36.963989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:52:36.963989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:36.963989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '13491d52-d823-4b46-9537-93441e1df6e3'} Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:52:36.964632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:36.965868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:52:36.967630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8c4a61ce-1320-4cb2-b5f1-0980b8775307 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Returning 404 to user: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:52:36.967630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8c4a61ce-1320-4cb2-b5f1-0980b8775307 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "DELETE /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 404 len: 111 microversion: 2.1 time: 0.032849 Jul 26 12:52:36.967630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 94/191] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:52:36 2022] DELETE /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:52:36.970960 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b05289bc-0a7e-41df-9f1a-c89e2a40f542 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:36.971566 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b05289bc-0a7e-41df-9f1a-c89e2a40f542 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] [instance: 13491d52-d823-4b46-9537-93441e1df6e3] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:36.980449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b05289bc-0a7e-41df-9f1a-c89e2a40f542 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:36.980449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b05289bc-0a7e-41df-9f1a-c89e2a40f542 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:36.980449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b05289bc-0a7e-41df-9f1a-c89e2a40f542 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:36.981075 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b05289bc-0a7e-41df-9f1a-c89e2a40f542 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:36.994323 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-b05289bc-0a7e-41df-9f1a-c89e2a40f542 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] HTTP exception thrown: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b05289bc-0a7e-41df-9f1a-c89e2a40f542 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Request method failure captured: Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 HTTP/1.1 Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-NRKJWhcWGUIhuLosalr6THTJxVylawMCOuMtvpqLjV49ypZJaeDqCQMH1pU0s2k7HvGwOhMG22sqiDZWhMJyeW2ZBARO70UJpJkGS5uI1Nr9rK3moeIjqqr1Gqi7irBnpcLKc899CxrBaZHW309PHedGShqoZzl7UW6xgSN5keRTo Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: 0f35a4b7696f4cdfbb6e6b316352c022 Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-DeleteServersTestJSON-1791744737 Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:52:36.995879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:52:36.997062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0f35a4b7696f4cdfbb6e6b316352c022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0f35a4b7696f4cdfbb6e6b316352c022", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f35a4b7696f4cdfbb6e6b316352c022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0f35a4b7696f4cdfbb6e6b316352c022"}]}] Jul 26 12:52:36.997062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-DeleteServersTestJSON-1791744737 Jul 26 12:52:36.997062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: 0f35a4b7696f4cdfbb6e6b316352c022 Jul 26 12:52:36.997062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-DeleteServersTestJSON-1791744737 Jul 26 12:52:36.997062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-DeleteServersTestJSON-1791744737-project Jul 26 12:52:36.997062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:52:36.997062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:52:36.997062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 7c4ed2f2f6994ae2bb00d5a502715b4f Jul 26 12:52:36.997062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-DeleteServersTestJSON-1791744737-project Jul 26 12:52:36.997062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:52:36.997062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:36.997062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '13491d52-d823-4b46-9537-93441e1df6e3'} Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:52:36.997785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. Jul 26 12:52:36.999125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:52:37.000188 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b05289bc-0a7e-41df-9f1a-c89e2a40f542 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] Returning 404 to user: Instance 13491d52-d823-4b46-9537-93441e1df6e3 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:52:37.000188 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b05289bc-0a7e-41df-9f1a-c89e2a40f542 tempest-DeleteServersTestJSON-1791744737 tempest-DeleteServersTestJSON-1791744737-project] 10.222.0.20 "GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3" status: 404 len: 111 microversion: 2.1 time: 0.030316 Jul 26 12:52:37.000188 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 98/192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:36 2022] GET /compute/v2.1/servers/13491d52-d823-4b46-9537-93441e1df6e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:52:37.748173 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-593a70b8-9e66-4cb2-8c4a-8e6455edc1f4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:37.749417 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-593a70b8-9e66-4cb2-8c4a-8e6455edc1f4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:37.760167 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-593a70b8-9e66-4cb2-8c4a-8e6455edc1f4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:37.761249 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-593a70b8-9e66-4cb2-8c4a-8e6455edc1f4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:37.762603 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-593a70b8-9e66-4cb2-8c4a-8e6455edc1f4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:37.763266 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-593a70b8-9e66-4cb2-8c4a-8e6455edc1f4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:37.953506 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-593a70b8-9e66-4cb2-8c4a-8e6455edc1f4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:37.962864 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-593a70b8-9e66-4cb2-8c4a-8e6455edc1f4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.219939 Jul 26 12:52:37.964800 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 95/193] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:37 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:38.987511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1b1a4f09-afd2-4e13-b1a1-2e42a01e2983 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:38.988590 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1b1a4f09-afd2-4e13-b1a1-2e42a01e2983 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:39.012435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1b1a4f09-afd2-4e13-b1a1-2e42a01e2983 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:39.014891 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1b1a4f09-afd2-4e13-b1a1-2e42a01e2983 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:39.015754 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1b1a4f09-afd2-4e13-b1a1-2e42a01e2983 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:39.016447 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1b1a4f09-afd2-4e13-b1a1-2e42a01e2983 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:39.162420 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1b1a4f09-afd2-4e13-b1a1-2e42a01e2983 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:39.175267 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1b1a4f09-afd2-4e13-b1a1-2e42a01e2983 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.191531 Jul 26 12:52:39.176666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 99/194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:38 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:40.197361 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d15de389-8159-4a4f-ba80-f5f2534c5610 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:40.198121 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d15de389-8159-4a4f-ba80-f5f2534c5610 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:40.206125 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d15de389-8159-4a4f-ba80-f5f2534c5610 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:40.206671 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d15de389-8159-4a4f-ba80-f5f2534c5610 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:40.207567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d15de389-8159-4a4f-ba80-f5f2534c5610 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:40.208148 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d15de389-8159-4a4f-ba80-f5f2534c5610 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:40.435758 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d15de389-8159-4a4f-ba80-f5f2534c5610 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:40.446068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d15de389-8159-4a4f-ba80-f5f2534c5610 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.253053 Jul 26 12:52:40.448638 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 96/195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:40 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:41.473434 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ce1f9f1f-0159-4cfd-a575-a4c3bf85c66c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:41.475241 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ce1f9f1f-0159-4cfd-a575-a4c3bf85c66c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:41.488070 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ce1f9f1f-0159-4cfd-a575-a4c3bf85c66c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:41.488740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ce1f9f1f-0159-4cfd-a575-a4c3bf85c66c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:41.489777 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ce1f9f1f-0159-4cfd-a575-a4c3bf85c66c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:41.490373 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ce1f9f1f-0159-4cfd-a575-a4c3bf85c66c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:41.698409 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ce1f9f1f-0159-4cfd-a575-a4c3bf85c66c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:41.702299 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ce1f9f1f-0159-4cfd-a575-a4c3bf85c66c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.232917 Jul 26 12:52:41.702871 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 100/196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:41 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:42.725796 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ec0c5a69-5f64-4c47-ab86-4ff6c1dbaea7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:42.726424 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ec0c5a69-5f64-4c47-ab86-4ff6c1dbaea7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:42.733749 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ec0c5a69-5f64-4c47-ab86-4ff6c1dbaea7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:42.734552 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ec0c5a69-5f64-4c47-ab86-4ff6c1dbaea7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:42.735558 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ec0c5a69-5f64-4c47-ab86-4ff6c1dbaea7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:42.736227 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ec0c5a69-5f64-4c47-ab86-4ff6c1dbaea7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:42.899878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ec0c5a69-5f64-4c47-ab86-4ff6c1dbaea7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:42.905375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ec0c5a69-5f64-4c47-ab86-4ff6c1dbaea7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.183685 Jul 26 12:52:42.915742 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 97/197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:42 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:43.927874 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-fa6c6aa8-e228-46d4-8c4a-158e8369a127 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:43.928521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-fa6c6aa8-e228-46d4-8c4a-158e8369a127 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:43.934702 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fa6c6aa8-e228-46d4-8c4a-158e8369a127 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:43.935148 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fa6c6aa8-e228-46d4-8c4a-158e8369a127 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:43.935956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fa6c6aa8-e228-46d4-8c4a-158e8369a127 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:43.936379 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fa6c6aa8-e228-46d4-8c4a-158e8369a127 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:44.072053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-fa6c6aa8-e228-46d4-8c4a-158e8369a127 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:44.079654 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-fa6c6aa8-e228-46d4-8c4a-158e8369a127 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.156094 Jul 26 12:52:44.080283 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 101/198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:43 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:45.101918 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5c90a435-7172-4c86-8262-d37393083f9c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:45.102699 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5c90a435-7172-4c86-8262-d37393083f9c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:45.105322 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=46 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:45.110681 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5c90a435-7172-4c86-8262-d37393083f9c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:45.111125 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5c90a435-7172-4c86-8262-d37393083f9c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:45.111922 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5c90a435-7172-4c86-8262-d37393083f9c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:45.112356 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5c90a435-7172-4c86-8262-d37393083f9c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:45.318751 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5c90a435-7172-4c86-8262-d37393083f9c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:45.327414 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5c90a435-7172-4c86-8262-d37393083f9c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.229890 Jul 26 12:52:45.328149 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 98/199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:45 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:46.350736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d05da7c9-af78-4a74-b417-3476e241e143 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:46.351334 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d05da7c9-af78-4a74-b417-3476e241e143 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:46.357260 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d05da7c9-af78-4a74-b417-3476e241e143 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:46.357700 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d05da7c9-af78-4a74-b417-3476e241e143 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:46.358487 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d05da7c9-af78-4a74-b417-3476e241e143 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:46.358979 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d05da7c9-af78-4a74-b417-3476e241e143 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:46.553267 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d05da7c9-af78-4a74-b417-3476e241e143 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:46.561354 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d05da7c9-af78-4a74-b417-3476e241e143 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.214866 Jul 26 12:52:46.561968 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 102/200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:46 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:47.588999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d22aea3f-7a9a-4419-99c8-6f96b5ccd05b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:47.590142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d22aea3f-7a9a-4419-99c8-6f96b5ccd05b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:47.597490 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d22aea3f-7a9a-4419-99c8-6f96b5ccd05b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:47.598053 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d22aea3f-7a9a-4419-99c8-6f96b5ccd05b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:47.599355 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d22aea3f-7a9a-4419-99c8-6f96b5ccd05b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:47.599822 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d22aea3f-7a9a-4419-99c8-6f96b5ccd05b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:47.758542 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d22aea3f-7a9a-4419-99c8-6f96b5ccd05b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:47.774764 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d22aea3f-7a9a-4419-99c8-6f96b5ccd05b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.190013 Jul 26 12:52:47.777241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 99/201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:47 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:48.801838 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ff655c2d-93b7-4877-a4eb-1b4ec79a16c4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:48.802441 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ff655c2d-93b7-4877-a4eb-1b4ec79a16c4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:48.808449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff655c2d-93b7-4877-a4eb-1b4ec79a16c4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:48.808892 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff655c2d-93b7-4877-a4eb-1b4ec79a16c4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:48.809644 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff655c2d-93b7-4877-a4eb-1b4ec79a16c4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:48.810073 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff655c2d-93b7-4877-a4eb-1b4ec79a16c4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:48.949258 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ff655c2d-93b7-4877-a4eb-1b4ec79a16c4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:48.953514 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:48.959264 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ff655c2d-93b7-4877-a4eb-1b4ec79a16c4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.161201 Jul 26 12:52:48.960092 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 103/202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:48 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:49.980877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-0d7a6aea-c999-42d3-8b19-864c2b957b6a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:49.981485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-0d7a6aea-c999-42d3-8b19-864c2b957b6a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:49.988050 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0d7a6aea-c999-42d3-8b19-864c2b957b6a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:49.988505 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0d7a6aea-c999-42d3-8b19-864c2b957b6a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:49.989269 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0d7a6aea-c999-42d3-8b19-864c2b957b6a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:49.989735 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0d7a6aea-c999-42d3-8b19-864c2b957b6a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:49.992288 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=95 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:50.127248 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-0d7a6aea-c999-42d3-8b19-864c2b957b6a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:50.135175 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-0d7a6aea-c999-42d3-8b19-864c2b957b6a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.158228 Jul 26 12:52:50.135760 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 100/203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:49 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:51.158919 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9e4ff690-3133-4df1-b215-752578b8d487 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:51.159672 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-9e4ff690-3133-4df1-b215-752578b8d487 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:51.167615 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9e4ff690-3133-4df1-b215-752578b8d487 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:51.168313 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9e4ff690-3133-4df1-b215-752578b8d487 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:51.169092 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9e4ff690-3133-4df1-b215-752578b8d487 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:51.169530 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9e4ff690-3133-4df1-b215-752578b8d487 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:51.305338 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-9e4ff690-3133-4df1-b215-752578b8d487 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:51.313270 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9e4ff690-3133-4df1-b215-752578b8d487 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.160274 Jul 26 12:52:51.313830 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 104/204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:51 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:52.335796 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8b9f6cb2-3484-4814-9e4e-72e28fd034c8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:52.336641 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8b9f6cb2-3484-4814-9e4e-72e28fd034c8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:52.346143 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8b9f6cb2-3484-4814-9e4e-72e28fd034c8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:52.346717 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8b9f6cb2-3484-4814-9e4e-72e28fd034c8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:52.347538 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8b9f6cb2-3484-4814-9e4e-72e28fd034c8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:52.348190 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8b9f6cb2-3484-4814-9e4e-72e28fd034c8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:52.481270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8b9f6cb2-3484-4814-9e4e-72e28fd034c8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:52.488831 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8b9f6cb2-3484-4814-9e4e-72e28fd034c8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.157595 Jul 26 12:52:52.489467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 101/205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:52 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:53.511416 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-76a93769-e865-421a-b75f-bb2358bf9f86 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:53.512024 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-76a93769-e865-421a-b75f-bb2358bf9f86 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:53.518047 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-76a93769-e865-421a-b75f-bb2358bf9f86 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:53.518495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-76a93769-e865-421a-b75f-bb2358bf9f86 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:53.519248 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-76a93769-e865-421a-b75f-bb2358bf9f86 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:53.519708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-76a93769-e865-421a-b75f-bb2358bf9f86 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:53.652863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-76a93769-e865-421a-b75f-bb2358bf9f86 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:53.660500 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-76a93769-e865-421a-b75f-bb2358bf9f86 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.152972 Jul 26 12:52:53.661555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 105/206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:53 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:54.683496 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-33f890f3-5a33-4e45-9d8f-c69df302456c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:54.684338 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-33f890f3-5a33-4e45-9d8f-c69df302456c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:54.690913 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-33f890f3-5a33-4e45-9d8f-c69df302456c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:54.691354 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-33f890f3-5a33-4e45-9d8f-c69df302456c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:54.692173 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-33f890f3-5a33-4e45-9d8f-c69df302456c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:54.692783 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-33f890f3-5a33-4e45-9d8f-c69df302456c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:54.828855 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-33f890f3-5a33-4e45-9d8f-c69df302456c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:54.836988 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-33f890f3-5a33-4e45-9d8f-c69df302456c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.157932 Jul 26 12:52:54.837664 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 102/207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:54 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:55.858796 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b5c0b557-2d92-41e0-8886-2e4bc229567a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:55.859571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b5c0b557-2d92-41e0-8886-2e4bc229567a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:55.862740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:52:55.867494 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b5c0b557-2d92-41e0-8886-2e4bc229567a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:55.867998 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b5c0b557-2d92-41e0-8886-2e4bc229567a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:55.868893 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b5c0b557-2d92-41e0-8886-2e4bc229567a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:55.869417 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b5c0b557-2d92-41e0-8886-2e4bc229567a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:56.022783 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-b5c0b557-2d92-41e0-8886-2e4bc229567a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:56.030773 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b5c0b557-2d92-41e0-8886-2e4bc229567a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.176034 Jul 26 12:52:56.031269 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 106/208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:55 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:52:57.053072 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3f79be32-b067-4356-8752-93d892ea1fba tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:57.053711 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3f79be32-b067-4356-8752-93d892ea1fba tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:57.061555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f79be32-b067-4356-8752-93d892ea1fba tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:57.061925 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f79be32-b067-4356-8752-93d892ea1fba tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:57.062710 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f79be32-b067-4356-8752-93d892ea1fba tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:57.063236 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f79be32-b067-4356-8752-93d892ea1fba tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:57.247086 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3f79be32-b067-4356-8752-93d892ea1fba tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:57.260359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3f79be32-b067-4356-8752-93d892ea1fba tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.212004 Jul 26 12:52:57.261152 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 103/209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:57 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:58.282199 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8c48e568-e71d-4353-b43b-b4d9839ef003 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:58.282873 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8c48e568-e71d-4353-b43b-b4d9839ef003 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:58.290842 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8c48e568-e71d-4353-b43b-b4d9839ef003 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:58.291309 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8c48e568-e71d-4353-b43b-b4d9839ef003 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:58.292191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8c48e568-e71d-4353-b43b-b4d9839ef003 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:58.292618 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8c48e568-e71d-4353-b43b-b4d9839ef003 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:58.426616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8c48e568-e71d-4353-b43b-b4d9839ef003 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:58.435686 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8c48e568-e71d-4353-b43b-b4d9839ef003 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.157780 Jul 26 12:52:58.436179 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 107/210] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:58 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:52:59.457358 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-719f3f83-1a54-4400-8ac2-a4550832f757 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:52:59.458391 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-719f3f83-1a54-4400-8ac2-a4550832f757 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:52:59.465441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-719f3f83-1a54-4400-8ac2-a4550832f757 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:59.465982 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-719f3f83-1a54-4400-8ac2-a4550832f757 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:59.466833 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-719f3f83-1a54-4400-8ac2-a4550832f757 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:52:59.467346 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-719f3f83-1a54-4400-8ac2-a4550832f757 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:52:59.663410 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-719f3f83-1a54-4400-8ac2-a4550832f757 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:52:59.671406 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-719f3f83-1a54-4400-8ac2-a4550832f757 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.218065 Jul 26 12:52:59.672199 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 104/211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:52:59 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:00.691889 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-697ee1f7-47e3-4bbd-ad77-4f35bb1c50c3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:00.693019 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-697ee1f7-47e3-4bbd-ad77-4f35bb1c50c3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:00.698968 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-697ee1f7-47e3-4bbd-ad77-4f35bb1c50c3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:00.699417 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-697ee1f7-47e3-4bbd-ad77-4f35bb1c50c3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:00.700247 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-697ee1f7-47e3-4bbd-ad77-4f35bb1c50c3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:00.700635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-697ee1f7-47e3-4bbd-ad77-4f35bb1c50c3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:00.839809 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-697ee1f7-47e3-4bbd-ad77-4f35bb1c50c3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:00.851149 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-697ee1f7-47e3-4bbd-ad77-4f35bb1c50c3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.161730 Jul 26 12:53:00.852741 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 108/212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:00 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:01.873126 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b31267fa-f5ad-49a7-90b8-87bb72d6cd04 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:01.873802 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b31267fa-f5ad-49a7-90b8-87bb72d6cd04 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:01.881103 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b31267fa-f5ad-49a7-90b8-87bb72d6cd04 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:01.881554 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b31267fa-f5ad-49a7-90b8-87bb72d6cd04 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:01.882440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b31267fa-f5ad-49a7-90b8-87bb72d6cd04 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:01.882789 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b31267fa-f5ad-49a7-90b8-87bb72d6cd04 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:02.034106 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b31267fa-f5ad-49a7-90b8-87bb72d6cd04 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:02.042445 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b31267fa-f5ad-49a7-90b8-87bb72d6cd04 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.173127 Jul 26 12:53:02.043120 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 105/213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:01 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:03.063553 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ef113b02-4ca2-41b6-ab46-356c5ce133d4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:03.064257 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ef113b02-4ca2-41b6-ab46-356c5ce133d4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:03.071116 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ef113b02-4ca2-41b6-ab46-356c5ce133d4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:03.071561 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ef113b02-4ca2-41b6-ab46-356c5ce133d4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:03.072385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ef113b02-4ca2-41b6-ab46-356c5ce133d4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:03.072812 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ef113b02-4ca2-41b6-ab46-356c5ce133d4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:03.216889 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ef113b02-4ca2-41b6-ab46-356c5ce133d4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:03.225366 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ef113b02-4ca2-41b6-ab46-356c5ce133d4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.165604 Jul 26 12:53:03.225934 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 109/214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:03 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:04.246098 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8c71827c-0164-493a-86f4-a13d25784882 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:04.246752 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8c71827c-0164-493a-86f4-a13d25784882 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:04.253712 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8c71827c-0164-493a-86f4-a13d25784882 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:04.254170 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8c71827c-0164-493a-86f4-a13d25784882 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:04.254941 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8c71827c-0164-493a-86f4-a13d25784882 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:04.255380 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8c71827c-0164-493a-86f4-a13d25784882 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:04.393058 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8c71827c-0164-493a-86f4-a13d25784882 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:04.402661 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8c71827c-0164-493a-86f4-a13d25784882 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1520 microversion: 2.1 time: 0.160321 Jul 26 12:53:04.404490 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 106/215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:04 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:05.425107 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-14cb64be-0a20-43ec-9cc7-82816565a6b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:05.425713 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-14cb64be-0a20-43ec-9cc7-82816565a6b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:05.431923 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-14cb64be-0a20-43ec-9cc7-82816565a6b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:05.432384 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-14cb64be-0a20-43ec-9cc7-82816565a6b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:05.433272 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-14cb64be-0a20-43ec-9cc7-82816565a6b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:05.433741 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-14cb64be-0a20-43ec-9cc7-82816565a6b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:05.601466 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-14cb64be-0a20-43ec-9cc7-82816565a6b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:05.610059 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-14cb64be-0a20-43ec-9cc7-82816565a6b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1500 microversion: 2.1 time: 0.189401 Jul 26 12:53:05.611037 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 110/216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:05 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1500 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:05.632499 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-109204cd-8139-4e1f-a05e-5cbba827e79e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:05.633293 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-109204cd-8139-4e1f-a05e-5cbba827e79e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:05.642497 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-109204cd-8139-4e1f-a05e-5cbba827e79e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:05.643068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-109204cd-8139-4e1f-a05e-5cbba827e79e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:05.644178 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-109204cd-8139-4e1f-a05e-5cbba827e79e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:05.644685 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-109204cd-8139-4e1f-a05e-5cbba827e79e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:05.861164 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-109204cd-8139-4e1f-a05e-5cbba827e79e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:05.869955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-109204cd-8139-4e1f-a05e-5cbba827e79e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1516 microversion: 2.1 time: 0.242394 Jul 26 12:53:05.870541 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 107/217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:05 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1516 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:07.293387 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1e3ae428-7d14-4c6e-a409-76474224e70d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:07.296542 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1e3ae428-7d14-4c6e-a409-76474224e70d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:07.303295 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1e3ae428-7d14-4c6e-a409-76474224e70d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:07.303775 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1e3ae428-7d14-4c6e-a409-76474224e70d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:07.304958 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1e3ae428-7d14-4c6e-a409-76474224e70d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:07.305619 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1e3ae428-7d14-4c6e-a409-76474224e70d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:07.329664 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-1e3ae428-7d14-4c6e-a409-76474224e70d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lazy-loading 'flavor' on Instance uuid 1a767a6a-b160-4f7d-970f-c45ff5bc1566 {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:53:07.427716 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1e3ae428-7d14-4c6e-a409-76474224e70d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "POST /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566/action" status: 200 len: 32 microversion: 2.1 time: 0.137694 Jul 26 12:53:07.434717 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 111/218] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 12:53:07 2022] POST /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566/action => generated 32 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 12:53:07.440675 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-17d4555b-b04c-4502-9675-438198f20a33 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:07.441921 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-17d4555b-b04c-4502-9675-438198f20a33 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:07.460794 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-17d4555b-b04c-4502-9675-438198f20a33 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:07.461246 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-17d4555b-b04c-4502-9675-438198f20a33 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:07.462244 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-17d4555b-b04c-4502-9675-438198f20a33 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:07.462864 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-17d4555b-b04c-4502-9675-438198f20a33 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:07.720144 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-17d4555b-b04c-4502-9675-438198f20a33 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:07.738222 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-17d4555b-b04c-4502-9675-438198f20a33 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.301264 Jul 26 12:53:07.740381 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 108/219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:07 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:08.761730 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7fe0103c-f18f-4866-ab3f-7bbc7d22b205 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:08.762430 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7fe0103c-f18f-4866-ab3f-7bbc7d22b205 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:08.768785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7fe0103c-f18f-4866-ab3f-7bbc7d22b205 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:08.769352 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7fe0103c-f18f-4866-ab3f-7bbc7d22b205 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:08.770132 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7fe0103c-f18f-4866-ab3f-7bbc7d22b205 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:08.770546 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7fe0103c-f18f-4866-ab3f-7bbc7d22b205 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:08.940618 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7fe0103c-f18f-4866-ab3f-7bbc7d22b205 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:08.948490 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7fe0103c-f18f-4866-ab3f-7bbc7d22b205 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.190871 Jul 26 12:53:08.949353 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 112/220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:08 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:09.972167 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-524cc5dc-fa99-42ad-9210-e17f50a96517 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:09.972828 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-524cc5dc-fa99-42ad-9210-e17f50a96517 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:09.980222 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-524cc5dc-fa99-42ad-9210-e17f50a96517 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:09.980986 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-524cc5dc-fa99-42ad-9210-e17f50a96517 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:09.982025 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-524cc5dc-fa99-42ad-9210-e17f50a96517 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:09.982470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-524cc5dc-fa99-42ad-9210-e17f50a96517 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:10.186328 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-524cc5dc-fa99-42ad-9210-e17f50a96517 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:10.195760 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-524cc5dc-fa99-42ad-9210-e17f50a96517 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.228295 Jul 26 12:53:10.209915 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 109/221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:09 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:11.216899 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-cefd7030-d406-46ce-b43c-44d797c4fbe8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:11.217495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-cefd7030-d406-46ce-b43c-44d797c4fbe8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:11.223536 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cefd7030-d406-46ce-b43c-44d797c4fbe8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:11.223993 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cefd7030-d406-46ce-b43c-44d797c4fbe8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:11.224745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cefd7030-d406-46ce-b43c-44d797c4fbe8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:11.225170 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cefd7030-d406-46ce-b43c-44d797c4fbe8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:11.360375 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-cefd7030-d406-46ce-b43c-44d797c4fbe8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:11.368426 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-cefd7030-d406-46ce-b43c-44d797c4fbe8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.155297 Jul 26 12:53:11.368996 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 113/222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:11 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:12.390650 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-db31f20d-7fce-494e-92b9-5027733d71db tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:12.391285 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-db31f20d-7fce-494e-92b9-5027733d71db tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:12.400063 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-db31f20d-7fce-494e-92b9-5027733d71db tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:12.400515 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-db31f20d-7fce-494e-92b9-5027733d71db tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:12.411865 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-db31f20d-7fce-494e-92b9-5027733d71db tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:12.411865 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-db31f20d-7fce-494e-92b9-5027733d71db tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:12.546052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-db31f20d-7fce-494e-92b9-5027733d71db tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:12.553808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-db31f20d-7fce-494e-92b9-5027733d71db tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.166982 Jul 26 12:53:12.554397 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 110/223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:12 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:13.578594 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f460889a-bdd8-405e-aa14-5c154c18481e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:13.579973 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f460889a-bdd8-405e-aa14-5c154c18481e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:13.589513 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f460889a-bdd8-405e-aa14-5c154c18481e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:13.590466 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f460889a-bdd8-405e-aa14-5c154c18481e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:13.591482 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f460889a-bdd8-405e-aa14-5c154c18481e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:13.591936 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f460889a-bdd8-405e-aa14-5c154c18481e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:13.737998 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f460889a-bdd8-405e-aa14-5c154c18481e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:13.745944 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f460889a-bdd8-405e-aa14-5c154c18481e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.172669 Jul 26 12:53:13.746513 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 114/224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:13 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:14.767748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-962d9e39-636b-49f2-aa74-5e8dc8757157 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:14.769295 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-962d9e39-636b-49f2-aa74-5e8dc8757157 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:14.776865 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-962d9e39-636b-49f2-aa74-5e8dc8757157 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:14.777325 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-962d9e39-636b-49f2-aa74-5e8dc8757157 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:14.778100 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-962d9e39-636b-49f2-aa74-5e8dc8757157 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:14.778545 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-962d9e39-636b-49f2-aa74-5e8dc8757157 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:14.936835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-962d9e39-636b-49f2-aa74-5e8dc8757157 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:14.951182 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-962d9e39-636b-49f2-aa74-5e8dc8757157 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.187139 Jul 26 12:53:14.952043 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 111/225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:14 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:15.976594 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5224f438-5d32-47c4-8a93-082cb90e850f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:15.977442 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-5224f438-5d32-47c4-8a93-082cb90e850f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:15.985281 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5224f438-5d32-47c4-8a93-082cb90e850f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:15.986124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5224f438-5d32-47c4-8a93-082cb90e850f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:15.987095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5224f438-5d32-47c4-8a93-082cb90e850f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:15.987525 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5224f438-5d32-47c4-8a93-082cb90e850f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:16.131012 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-5224f438-5d32-47c4-8a93-082cb90e850f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:16.138483 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-5224f438-5d32-47c4-8a93-082cb90e850f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.168633 Jul 26 12:53:16.139198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 115/226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:15 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:17.162345 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-675faec8-7789-4473-9a43-53fcd6795751 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:17.163055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-675faec8-7789-4473-9a43-53fcd6795751 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:17.169404 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=28 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:17.171907 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-675faec8-7789-4473-9a43-53fcd6795751 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:17.172425 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-675faec8-7789-4473-9a43-53fcd6795751 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:17.173439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-675faec8-7789-4473-9a43-53fcd6795751 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:17.173943 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-675faec8-7789-4473-9a43-53fcd6795751 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:17.418262 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-675faec8-7789-4473-9a43-53fcd6795751 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:17.428285 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-675faec8-7789-4473-9a43-53fcd6795751 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.270880 Jul 26 12:53:17.428907 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 112/227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:17 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:18.265481 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1059355808", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452"}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:18.457280 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-0aec5664-d1ab-439f-a008-8173d52868a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:18.458403 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-0aec5664-d1ab-439f-a008-8173d52868a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:18.468387 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0aec5664-d1ab-439f-a008-8173d52868a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:18.468851 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0aec5664-d1ab-439f-a008-8173d52868a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:18.469658 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0aec5664-d1ab-439f-a008-8173d52868a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:18.470098 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0aec5664-d1ab-439f-a008-8173d52868a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:18.705152 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-0aec5664-d1ab-439f-a008-8173d52868a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:18.713838 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-0aec5664-d1ab-439f-a008-8173d52868a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.261055 Jul 26 12:53:18.714418 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 113/228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:18 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:19.734876 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9e8c2496-3013-4839-8fde-eb1cd7790010 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:19.735864 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9e8c2496-3013-4839-8fde-eb1cd7790010 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:19.742584 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9e8c2496-3013-4839-8fde-eb1cd7790010 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:19.743057 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9e8c2496-3013-4839-8fde-eb1cd7790010 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:19.743849 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9e8c2496-3013-4839-8fde-eb1cd7790010 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:19.744294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9e8c2496-3013-4839-8fde-eb1cd7790010 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:19.886577 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9e8c2496-3013-4839-8fde-eb1cd7790010 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:19.894402 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9e8c2496-3013-4839-8fde-eb1cd7790010 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.163523 Jul 26 12:53:19.895551 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 114/229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:19 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:20.534053 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1676495017", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "networks": [{"uuid": "6f3c6a72-7f77-4ac8-bef3-87195153f5df"}]}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:25.761462 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.network.neutron [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] validate_networks() for None {{(pid=129308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:53:25.769926 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.network.neutron [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] validate_networks() for [('6f3c6a72-7f77-4ac8-bef3-87195153f5df', None, None, None, None, None)] {{(pid=129307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:53:26.097359 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Flavor limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:53:26.098819 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Image limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:53:26.099483 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Flavor pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:53:26.099917 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Image pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:53:26.100754 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:53:26.104200 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=22 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:26.115077 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:26.115521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:26.116555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:26.116990 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:26.125029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:26.138936 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Getting quotas for project fbda6b838e3b4a8f89a693e4c5174695. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:53:26.143304 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Getting quotas for user bc8e48fa3a38429b9925b519ca28c1e2 and project fbda6b838e3b4a8f89a693e4c5174695. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:53:26.148655 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Flavor limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:53:26.149162 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Image limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:53:26.150525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Flavor pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:53:26.151099 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Image pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:53:26.151864 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:53:26.155718 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Going to run 1 instances... {{(pid=129308) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:53:26.157984 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:53:26.165339 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:26.165825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:26.166630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:26.167075 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:26.174772 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=90 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:26.194509 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Getting quotas for project fa4a3dadafc44483ad16923db53db457. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:53:26.198851 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Getting quotas for user 7a6832c70c0c401985bc4f26a787080f and project fa4a3dadafc44483ad16923db53db457. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:53:26.209207 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-746c2ec9-f1b7-4e91-8be4-e559a7c76871 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.947506 Jul 26 12:53:26.209939 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 116/230] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:53:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 7949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 12:53:26.210150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Going to run 1 instances... {{(pid=129307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:53:26.212794 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:53:26.214548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-27183030-66c5-4075-a07e-0f116fc04aed tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:26.215143 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-27183030-66c5-4075-a07e-0f116fc04aed tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:26.221240 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-27183030-66c5-4075-a07e-0f116fc04aed tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:26.221689 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-27183030-66c5-4075-a07e-0f116fc04aed tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:26.222441 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-27183030-66c5-4075-a07e-0f116fc04aed tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:26.222872 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-27183030-66c5-4075-a07e-0f116fc04aed tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:26.300183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3f659536-4a44-4957-90a9-6aaadb4b7544 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.769898 Jul 26 12:53:26.300819 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 115/231] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:53:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 5771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 12:53:26.307898 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4dd6ec50-b6a1-41bd-b5c1-48bbfd676117 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:26.308647 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4dd6ec50-b6a1-41bd-b5c1-48bbfd676117 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:26.315073 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4dd6ec50-b6a1-41bd-b5c1-48bbfd676117 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:26.315519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4dd6ec50-b6a1-41bd-b5c1-48bbfd676117 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:26.316332 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4dd6ec50-b6a1-41bd-b5c1-48bbfd676117 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:26.316763 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4dd6ec50-b6a1-41bd-b5c1-48bbfd676117 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:26.352232 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4dd6ec50-b6a1-41bd-b5c1-48bbfd676117 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/ips" status: 200 len: 153 microversion: 2.20 time: 0.050089 Jul 26 12:53:26.352981 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 116/232] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Jul 26 12:53:26 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/ips => generated 153 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:53:26.362733 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-a6b3fc50-24b2-4d35-bdc6-30dc5f08f130 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:26.363237 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-a6b3fc50-24b2-4d35-bdc6-30dc5f08f130 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:26.375106 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a6b3fc50-24b2-4d35-bdc6-30dc5f08f130 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:26.375939 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a6b3fc50-24b2-4d35-bdc6-30dc5f08f130 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:26.376927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a6b3fc50-24b2-4d35-bdc6-30dc5f08f130 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:26.377620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a6b3fc50-24b2-4d35-bdc6-30dc5f08f130 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:26.419787 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-a6b3fc50-24b2-4d35-bdc6-30dc5f08f130 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4/ips" status: 200 len: 150 microversion: 2.1 time: 0.062924 Jul 26 12:53:26.424325 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 117/233] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Jul 26 12:53:26 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4/ips => generated 150 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:53:26.448836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f022454f-c9d9-429d-a438-3438acf8af7e tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:26.449548 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f022454f-c9d9-429d-a438-3438acf8af7e tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:26.475933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-27183030-66c5-4075-a07e-0f116fc04aed tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:26.496406 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-27183030-66c5-4075-a07e-0f116fc04aed tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.284371 Jul 26 12:53:26.515007 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 117/234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:26 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:26.522002 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b441a6b9-f0c1-482d-9937-1ae9ca774b7b tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:26.522623 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b441a6b9-f0c1-482d-9937-1ae9ca774b7b tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:26.596542 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-b441a6b9-f0c1-482d-9937-1ae9ca774b7b tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:26.603406 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f022454f-c9d9-429d-a438-3438acf8af7e tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:26.607468 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b441a6b9-f0c1-482d-9937-1ae9ca774b7b tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1219 microversion: 2.1 time: 0.091202 Jul 26 12:53:26.613366 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f022454f-c9d9-429d-a438-3438acf8af7e tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1215 microversion: 2.1 time: 0.187521 Jul 26 12:53:26.617127 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 118/235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:26 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1215 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:26.627771 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 118/236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:26 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:27.522790 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b0f7f6d9-9d35-4837-a8b4-4324c10f2ff6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:27.523775 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b0f7f6d9-9d35-4837-a8b4-4324c10f2ff6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:27.530308 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b0f7f6d9-9d35-4837-a8b4-4324c10f2ff6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:27.530761 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b0f7f6d9-9d35-4837-a8b4-4324c10f2ff6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:27.531528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b0f7f6d9-9d35-4837-a8b4-4324c10f2ff6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:27.531991 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b0f7f6d9-9d35-4837-a8b4-4324c10f2ff6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:27.632231 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ca2220a6-3708-421a-a9fe-8c3f8f81db75 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:27.633564 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ca2220a6-3708-421a-a9fe-8c3f8f81db75 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:27.640774 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ca2220a6-3708-421a-a9fe-8c3f8f81db75 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:27.641229 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ca2220a6-3708-421a-a9fe-8c3f8f81db75 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:27.642007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ca2220a6-3708-421a-a9fe-8c3f8f81db75 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:27.642448 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ca2220a6-3708-421a-a9fe-8c3f8f81db75 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:27.673787 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-b0f7f6d9-9d35-4837-a8b4-4324c10f2ff6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:27.682037 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b0f7f6d9-9d35-4837-a8b4-4324c10f2ff6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.163868 Jul 26 12:53:27.682673 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 119/237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:27 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:27.702529 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-bfa3a026-05ab-4c95-a492-e1dbe087bce2 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:27.703196 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-bfa3a026-05ab-4c95-a492-e1dbe087bce2 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:27.710350 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bfa3a026-05ab-4c95-a492-e1dbe087bce2 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:27.710812 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bfa3a026-05ab-4c95-a492-e1dbe087bce2 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:27.711579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bfa3a026-05ab-4c95-a492-e1dbe087bce2 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:27.712053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bfa3a026-05ab-4c95-a492-e1dbe087bce2 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:27.712540 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ca2220a6-3708-421a-a9fe-8c3f8f81db75 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:27.720158 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ca2220a6-3708-421a-a9fe-8c3f8f81db75 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1271 microversion: 2.1 time: 0.093210 Jul 26 12:53:27.731662 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 119/238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:27 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:27.774424 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-bfa3a026-05ab-4c95-a492-e1dbe087bce2 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:27.782180 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-bfa3a026-05ab-4c95-a492-e1dbe087bce2 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1267 microversion: 2.1 time: 0.083719 Jul 26 12:53:27.782765 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 120/239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:27 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:28.017360 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f0625648-ba52-4a5b-91bc-6c034e4721ce tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65fc12ea-eb12-4dee-bf90-2ccff6640c7c"}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:28.019879 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f0625648-ba52-4a5b-91bc-6c034e4721ce tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:28.026865 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f0625648-ba52-4a5b-91bc-6c034e4721ce tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:28.027223 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f0625648-ba52-4a5b-91bc-6c034e4721ce tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:28.028027 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f0625648-ba52-4a5b-91bc-6c034e4721ce tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:28.028458 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f0625648-ba52-4a5b-91bc-6c034e4721ce tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:28.704424 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-09115013-3d1c-4c35-85a1-0542d4d6f519 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:28.705034 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-09115013-3d1c-4c35-85a1-0542d4d6f519 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:28.711074 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-09115013-3d1c-4c35-85a1-0542d4d6f519 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:28.711539 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-09115013-3d1c-4c35-85a1-0542d4d6f519 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:28.712343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-09115013-3d1c-4c35-85a1-0542d4d6f519 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:28.712781 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-09115013-3d1c-4c35-85a1-0542d4d6f519 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:28.842133 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-09115013-3d1c-4c35-85a1-0542d4d6f519 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:28.851030 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-09115013-3d1c-4c35-85a1-0542d4d6f519 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1502 microversion: 2.1 time: 0.150403 Jul 26 12:53:28.851811 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 121/240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:28 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:28.857199 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-62c46698-29f9-43b9-bb42-33822ca51999 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:28.857737 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-62c46698-29f9-43b9-bb42-33822ca51999 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:28.865041 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-62c46698-29f9-43b9-bb42-33822ca51999 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:28.865517 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-62c46698-29f9-43b9-bb42-33822ca51999 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:28.866326 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-62c46698-29f9-43b9-bb42-33822ca51999 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:28.866791 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-62c46698-29f9-43b9-bb42-33822ca51999 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:28.889597 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-62c46698-29f9-43b9-bb42-33822ca51999 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lazy-loading 'flavor' on Instance uuid 20220b7e-2897-4f0c-98da-3f352aa39ec2 {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:53:29.106294 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-62c46698-29f9-43b9-bb42-33822ca51999 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "POST /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/action" status: 202 len: 0 microversion: 2.20 time: 0.253267 Jul 26 12:53:29.106900 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 122/241] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Jul 26 12:53:28 2022] POST /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:53:29.111854 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c6b376ef-a9f8-4317-bc29-402e923ef115 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:29.112541 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c6b376ef-a9f8-4317-bc29-402e923ef115 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:29.122426 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c6b376ef-a9f8-4317-bc29-402e923ef115 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:29.122852 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c6b376ef-a9f8-4317-bc29-402e923ef115 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:29.123564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c6b376ef-a9f8-4317-bc29-402e923ef115 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:29.124071 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c6b376ef-a9f8-4317-bc29-402e923ef115 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:29.217421 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c6b376ef-a9f8-4317-bc29-402e923ef115 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:29.225915 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c6b376ef-a9f8-4317-bc29-402e923ef115 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1279 microversion: 2.1 time: 0.117845 Jul 26 12:53:29.239044 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 123/242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:29 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1279 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:29.239044 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f08454d2-5475-4cf6-9e8e-4792bdd3fc11 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:29.239044 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f08454d2-5475-4cf6-9e8e-4792bdd3fc11 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:29.239044 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f08454d2-5475-4cf6-9e8e-4792bdd3fc11 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:29.239528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f08454d2-5475-4cf6-9e8e-4792bdd3fc11 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:29.240118 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f08454d2-5475-4cf6-9e8e-4792bdd3fc11 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:29.240662 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f08454d2-5475-4cf6-9e8e-4792bdd3fc11 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:29.330735 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f08454d2-5475-4cf6-9e8e-4792bdd3fc11 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:29.340371 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f08454d2-5475-4cf6-9e8e-4792bdd3fc11 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1285 microversion: 2.1 time: 0.112824 Jul 26 12:53:29.354455 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 124/243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:29 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:29.359532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3a8af37b-1f92-4919-a135-83557e778cd1 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8c21cea-983c-481c-9d10-e96809608df0"}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:29.362275 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3a8af37b-1f92-4919-a135-83557e778cd1 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:29.374000 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a8af37b-1f92-4919-a135-83557e778cd1 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:29.374834 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a8af37b-1f92-4919-a135-83557e778cd1 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:29.375722 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a8af37b-1f92-4919-a135-83557e778cd1 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:29.376251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a8af37b-1f92-4919-a135-83557e778cd1 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:29.396715 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f0625648-ba52-4a5b-91bc-6c034e4721ce tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "POST /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.382347 Jul 26 12:53:29.403442 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 120/244] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 12:53:28 2022] POST /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4/os-volume_attachments => generated 194 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:53:29.413488 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-bc2564a9-498f-4e1e-a2d8-4295b9dff036 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:29.414381 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-bc2564a9-498f-4e1e-a2d8-4295b9dff036 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:29.418386 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-3a8af37b-1f92-4919-a135-83557e778cd1 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] HTTP exception thrown: Cannot 'attach_volume' instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 while it is in vm_state rescued Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3a8af37b-1f92-4919-a135-83557e778cd1 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Request method failure captured: Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: POST /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566/os-volume_attachments HTTP/1.1 Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 74 Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-NLseOU0YmIJgrSP1iVFQKab0I0wnEpm8gTrXCuBzFbpoKQTbc_ctfnrVbevburiE7sm0kD-N0KGIA9K76AJduIP27Sf1Y34WxwJtmrVV5YLgZg5S21dVDnnQMNlaZxrh5vweBHLudYSY3-D1c0nDVQKxHmGjC5iwiZ1_78oFSAOL4 Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: d92bfe73c0a54823a88a89f9ae627134 Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:53:29.421745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:53:29.423341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d92bfe73c0a54823a88a89f9ae627134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d92bfe73c0a54823a88a89f9ae627134", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d92bfe73c0a54823a88a89f9ae627134"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d92bfe73c0a54823a88a89f9ae627134"}]}] Jul 26 12:53:29.423341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:53:29.423341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: d92bfe73c0a54823a88a89f9ae627134 Jul 26 12:53:29.423341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:53:29.423341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-ServerRescueNegativeTestJSON-871230559-project Jul 26 12:53:29.423341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:53:29.423341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:53:29.423341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 2b5894762d4b4cc99521bc224d2bddd7 Jul 26 12:53:29.423341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-ServerRescueNegativeTestJSON-871230559-project Jul 26 12:53:29.423341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Jul 26 12:53:29.423341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {"volumeAttachment": {"volumeId": "f8c21cea-983c-481c-9d10-e96809608df0"}} Jul 26 12:53:29.423341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Cannot 'attach_volume' instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 while it is in vm_state rescued Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'server_id': '1a767a6a-b160-4f7d-970f-c45ff5bc1566', 'body': {'volumeAttachment': {'volumeId': 'f8c21cea-983c-481c-9d10-e96809608df0'}}} Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:53:29.424341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 while it is in vm_state rescued Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:53:29.425831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:53:29.427954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:53:29.427954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:53:29.427954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 while it is in vm_state rescued Jul 26 12:53:29.427954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:53:29.427954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3a8af37b-1f92-4919-a135-83557e778cd1 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Returning 409 to user: Cannot 'attach_volume' instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 while it is in vm_state rescued {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:53:29.427954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3a8af37b-1f92-4919-a135-83557e778cd1 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "POST /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067790 Jul 26 12:53:29.427954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 125/245] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 12:53:29 2022] POST /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 12:53:29.429690 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bc2564a9-498f-4e1e-a2d8-4295b9dff036 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:29.430314 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bc2564a9-498f-4e1e-a2d8-4295b9dff036 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:29.431263 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bc2564a9-498f-4e1e-a2d8-4295b9dff036 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:29.431920 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bc2564a9-498f-4e1e-a2d8-4295b9dff036 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:29.434239 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-cbf0bdb6-4cef-4749-b950-873a7734ffa3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:29.434914 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-cbf0bdb6-4cef-4749-b950-873a7734ffa3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:29.441942 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cbf0bdb6-4cef-4749-b950-873a7734ffa3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:29.442950 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cbf0bdb6-4cef-4749-b950-873a7734ffa3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:29.443882 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cbf0bdb6-4cef-4749-b950-873a7734ffa3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:29.444391 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cbf0bdb6-4cef-4749-b950-873a7734ffa3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:29.537335 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-cbf0bdb6-4cef-4749-b950-873a7734ffa3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "POST /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566/action" status: 202 len: 0 microversion: 2.1 time: 0.104340 Jul 26 12:53:29.543567 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 126/246] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 12:53:29 2022] POST /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 12:53:29.552162 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a7daca87-5129-4cc8-8442-25fccce0998c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:29.552938 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-a7daca87-5129-4cc8-8442-25fccce0998c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:29.562019 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a7daca87-5129-4cc8-8442-25fccce0998c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:29.562531 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a7daca87-5129-4cc8-8442-25fccce0998c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:29.563813 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a7daca87-5129-4cc8-8442-25fccce0998c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:29.564636 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a7daca87-5129-4cc8-8442-25fccce0998c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:29.758990 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-a7daca87-5129-4cc8-8442-25fccce0998c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:29.767078 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a7daca87-5129-4cc8-8442-25fccce0998c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1510 microversion: 2.1 time: 0.220534 Jul 26 12:53:29.767670 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 127/247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:29 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:30.047017 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bc2564a9-498f-4e1e-a2d8-4295b9dff036 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:30.054593 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bc2564a9-498f-4e1e-a2d8-4295b9dff036 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:30.056265 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bc2564a9-498f-4e1e-a2d8-4295b9dff036 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:30.057565 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-bc2564a9-498f-4e1e-a2d8-4295b9dff036 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.651679 Jul 26 12:53:30.058365 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 121/248] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:29 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:30.254061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3d51b439-4d27-4753-a413-3090fe8cc18f tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:30.255814 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3d51b439-4d27-4753-a413-3090fe8cc18f tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:30.262570 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3d51b439-4d27-4753-a413-3090fe8cc18f tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:30.263296 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3d51b439-4d27-4753-a413-3090fe8cc18f tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:30.264401 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3d51b439-4d27-4753-a413-3090fe8cc18f tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:30.265068 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3d51b439-4d27-4753-a413-3090fe8cc18f tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:30.362995 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6dfa84aa-dda6-4054-8de3-d4d4c2d1dd57 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:30.364138 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-6dfa84aa-dda6-4054-8de3-d4d4c2d1dd57 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:30.377217 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6dfa84aa-dda6-4054-8de3-d4d4c2d1dd57 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:30.377757 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6dfa84aa-dda6-4054-8de3-d4d4c2d1dd57 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:30.378615 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6dfa84aa-dda6-4054-8de3-d4d4c2d1dd57 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:30.379249 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6dfa84aa-dda6-4054-8de3-d4d4c2d1dd57 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:30.426708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3d51b439-4d27-4753-a413-3090fe8cc18f tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:30.442247 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3d51b439-4d27-4753-a413-3090fe8cc18f tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1277 microversion: 2.1 time: 0.198730 Jul 26 12:53:30.443369 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 128/249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:30 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:30.495137 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-6dfa84aa-dda6-4054-8de3-d4d4c2d1dd57 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:30.520310 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-6dfa84aa-dda6-4054-8de3-d4d4c2d1dd57 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1273 microversion: 2.1 time: 0.162863 Jul 26 12:53:30.521537 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 122/250] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:30 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:30.788466 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ff561f07-9e2c-4d9b-88d1-f6ea634eb0da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:30.790310 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ff561f07-9e2c-4d9b-88d1-f6ea634eb0da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:30.795391 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff561f07-9e2c-4d9b-88d1-f6ea634eb0da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:30.795872 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff561f07-9e2c-4d9b-88d1-f6ea634eb0da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:30.796641 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff561f07-9e2c-4d9b-88d1-f6ea634eb0da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:30.797074 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff561f07-9e2c-4d9b-88d1-f6ea634eb0da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:30.937247 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ff561f07-9e2c-4d9b-88d1-f6ea634eb0da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:30.946409 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ff561f07-9e2c-4d9b-88d1-f6ea634eb0da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1510 microversion: 2.1 time: 0.161879 Jul 26 12:53:30.948012 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 129/251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:30 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:31.080911 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-cfd89e6e-9911-407f-8350-35c7e4816022 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:31.081535 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-cfd89e6e-9911-407f-8350-35c7e4816022 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:31.090529 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfd89e6e-9911-407f-8350-35c7e4816022 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:31.090988 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfd89e6e-9911-407f-8350-35c7e4816022 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:31.092316 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfd89e6e-9911-407f-8350-35c7e4816022 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:31.092316 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfd89e6e-9911-407f-8350-35c7e4816022 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:31.240487 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-cfd89e6e-9911-407f-8350-35c7e4816022 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:31.248448 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-cfd89e6e-9911-407f-8350-35c7e4816022 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:31.250223 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-cfd89e6e-9911-407f-8350-35c7e4816022 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:31.251386 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-cfd89e6e-9911-407f-8350-35c7e4816022 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.174528 Jul 26 12:53:31.251993 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 123/252] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:31 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:53:31.464666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3c024df0-d055-45c5-9420-21d2594ada82 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:31.465320 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3c024df0-d055-45c5-9420-21d2594ada82 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:31.471209 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3c024df0-d055-45c5-9420-21d2594ada82 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:31.471722 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3c024df0-d055-45c5-9420-21d2594ada82 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:31.472623 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3c024df0-d055-45c5-9420-21d2594ada82 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:31.473059 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3c024df0-d055-45c5-9420-21d2594ada82 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:31.542094 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e9b3fb3f-7a31-4d2f-a66b-c75942d3b5aa tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:31.542870 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e9b3fb3f-7a31-4d2f-a66b-c75942d3b5aa tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:31.551235 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e9b3fb3f-7a31-4d2f-a66b-c75942d3b5aa tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:31.551717 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e9b3fb3f-7a31-4d2f-a66b-c75942d3b5aa tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:31.552540 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e9b3fb3f-7a31-4d2f-a66b-c75942d3b5aa tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:31.552977 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e9b3fb3f-7a31-4d2f-a66b-c75942d3b5aa tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:31.613661 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3c024df0-d055-45c5-9420-21d2594ada82 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:31.632814 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3c024df0-d055-45c5-9420-21d2594ada82 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1319 microversion: 2.1 time: 0.171827 Jul 26 12:53:31.636036 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 130/253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:31 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:31.721061 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e9b3fb3f-7a31-4d2f-a66b-c75942d3b5aa tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:31.729911 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e9b3fb3f-7a31-4d2f-a66b-c75942d3b5aa tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.191515 Jul 26 12:53:31.730873 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 124/254] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:31 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:31.969477 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-47b8fdf4-ec77-4c61-8285-d8ecd7b9210f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:31.970075 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-47b8fdf4-ec77-4c61-8285-d8ecd7b9210f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:31.976181 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-47b8fdf4-ec77-4c61-8285-d8ecd7b9210f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:31.976715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-47b8fdf4-ec77-4c61-8285-d8ecd7b9210f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:31.977468 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-47b8fdf4-ec77-4c61-8285-d8ecd7b9210f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:31.977904 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-47b8fdf4-ec77-4c61-8285-d8ecd7b9210f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:32.112414 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-47b8fdf4-ec77-4c61-8285-d8ecd7b9210f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:32.114745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:32.122533 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-47b8fdf4-ec77-4c61-8285-d8ecd7b9210f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1510 microversion: 2.1 time: 0.156837 Jul 26 12:53:32.123106 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 131/255] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:31 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:32.280217 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-74331a25-bc72-47d7-b0b5-b786390ac530 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:32.280819 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-74331a25-bc72-47d7-b0b5-b786390ac530 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:32.286811 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-74331a25-bc72-47d7-b0b5-b786390ac530 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:32.287253 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-74331a25-bc72-47d7-b0b5-b786390ac530 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:32.288039 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-74331a25-bc72-47d7-b0b5-b786390ac530 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:32.288493 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-74331a25-bc72-47d7-b0b5-b786390ac530 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:32.639946 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-74331a25-bc72-47d7-b0b5-b786390ac530 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:32.648413 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-74331a25-bc72-47d7-b0b5-b786390ac530 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:32.650521 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-74331a25-bc72-47d7-b0b5-b786390ac530 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:32.652192 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-74331a25-bc72-47d7-b0b5-b786390ac530 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.375875 Jul 26 12:53:32.652926 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 125/256] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:32 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:32.655191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c5680bec-52a1-4ad1-9aa2-deeb4a2054fd tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:32.655860 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c5680bec-52a1-4ad1-9aa2-deeb4a2054fd tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:32.666407 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c5680bec-52a1-4ad1-9aa2-deeb4a2054fd tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:32.673057 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c5680bec-52a1-4ad1-9aa2-deeb4a2054fd tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:32.673870 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c5680bec-52a1-4ad1-9aa2-deeb4a2054fd tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:32.674313 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c5680bec-52a1-4ad1-9aa2-deeb4a2054fd tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:32.753648 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5f9b5967-7c5d-4758-8eb8-fd7f4a714960 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:32.754533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5f9b5967-7c5d-4758-8eb8-fd7f4a714960 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:32.760760 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5f9b5967-7c5d-4758-8eb8-fd7f4a714960 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:32.761216 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5f9b5967-7c5d-4758-8eb8-fd7f4a714960 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:32.762208 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5f9b5967-7c5d-4758-8eb8-fd7f4a714960 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:32.762577 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5f9b5967-7c5d-4758-8eb8-fd7f4a714960 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:32.820822 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c5680bec-52a1-4ad1-9aa2-deeb4a2054fd tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:32.828280 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c5680bec-52a1-4ad1-9aa2-deeb4a2054fd tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1319 microversion: 2.1 time: 0.176456 Jul 26 12:53:32.828432 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 132/257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:32 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:33.117108 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5f9b5967-7c5d-4758-8eb8-fd7f4a714960 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:33.125117 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5f9b5967-7c5d-4758-8eb8-fd7f4a714960 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.375066 Jul 26 12:53:33.138979 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 126/258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:32 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:33.145885 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-10c776cd-c5db-43ff-827b-f2f2490b8bca tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:33.146538 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-10c776cd-c5db-43ff-827b-f2f2490b8bca tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:33.153186 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-10c776cd-c5db-43ff-827b-f2f2490b8bca tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:33.153649 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-10c776cd-c5db-43ff-827b-f2f2490b8bca tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:33.154425 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-10c776cd-c5db-43ff-827b-f2f2490b8bca tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:33.154862 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-10c776cd-c5db-43ff-827b-f2f2490b8bca tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:33.293648 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-10c776cd-c5db-43ff-827b-f2f2490b8bca tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:33.301546 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-10c776cd-c5db-43ff-827b-f2f2490b8bca tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1510 microversion: 2.1 time: 0.159551 Jul 26 12:53:33.302667 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 133/259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:33 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:33.351115 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-77ae9843-4022-4c70-8b5b-1f9650d83905 req-4e5081a0-2666-4b03-b021-95bb8b2ba2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc189b1-f457-4614-9639-b10131941960", "tag": "53cbdca1-deba-44f6-8b56-5b94884fd66d"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:33.361142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-77ae9843-4022-4c70-8b5b-1f9650d83905 req-4e5081a0-2666-4b03-b021-95bb8b2ba2e8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:33.361601 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-77ae9843-4022-4c70-8b5b-1f9650d83905 req-4e5081a0-2666-4b03-b021-95bb8b2ba2e8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:33.373455 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-77ae9843-4022-4c70-8b5b-1f9650d83905 req-4e5081a0-2666-4b03-b021-95bb8b2ba2e8 service nova] Creating event network-changed:53cbdca1-deba-44f6-8b56-5b94884fd66d for instance 9dc189b1-f457-4614-9639-b10131941960 on hv-cinder-85093 Jul 26 12:53:33.380987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-77ae9843-4022-4c70-8b5b-1f9650d83905 req-4e5081a0-2666-4b03-b021-95bb8b2ba2e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033993 Jul 26 12:53:33.382472 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 127/260] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:53:33.676237 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ef350044-6f2b-4260-bb5d-9756aaca0c22 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:33.677458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ef350044-6f2b-4260-bb5d-9756aaca0c22 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:33.683484 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ef350044-6f2b-4260-bb5d-9756aaca0c22 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:33.683969 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ef350044-6f2b-4260-bb5d-9756aaca0c22 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:33.684730 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ef350044-6f2b-4260-bb5d-9756aaca0c22 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:33.685164 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ef350044-6f2b-4260-bb5d-9756aaca0c22 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:33.818675 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ef350044-6f2b-4260-bb5d-9756aaca0c22 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:33.826492 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ef350044-6f2b-4260-bb5d-9756aaca0c22 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:33.828021 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ef350044-6f2b-4260-bb5d-9756aaca0c22 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:33.829154 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ef350044-6f2b-4260-bb5d-9756aaca0c22 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.156945 Jul 26 12:53:33.829702 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 134/261] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:33 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:33.850368 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d84a25e1-0aac-4d19-9396-5200131ae8be tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:33.851072 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d84a25e1-0aac-4d19-9396-5200131ae8be tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:33.857339 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d84a25e1-0aac-4d19-9396-5200131ae8be tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:33.857793 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d84a25e1-0aac-4d19-9396-5200131ae8be tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:33.858558 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d84a25e1-0aac-4d19-9396-5200131ae8be tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:33.858996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d84a25e1-0aac-4d19-9396-5200131ae8be tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:33.996055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d84a25e1-0aac-4d19-9396-5200131ae8be tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:34.003620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d84a25e1-0aac-4d19-9396-5200131ae8be tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1319 microversion: 2.1 time: 0.158453 Jul 26 12:53:34.004215 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 128/262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:33 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:34.146711 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-817855d5-71cc-492d-9bc0-4441400ec397 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:34.147306 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-817855d5-71cc-492d-9bc0-4441400ec397 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:34.153335 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-817855d5-71cc-492d-9bc0-4441400ec397 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:34.153782 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-817855d5-71cc-492d-9bc0-4441400ec397 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:34.154521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-817855d5-71cc-492d-9bc0-4441400ec397 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:34.154952 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-817855d5-71cc-492d-9bc0-4441400ec397 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:34.282184 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-817855d5-71cc-492d-9bc0-4441400ec397 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:34.289595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-817855d5-71cc-492d-9bc0-4441400ec397 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.147264 Jul 26 12:53:34.290166 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 135/263] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:34 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:34.323415 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-a41e2b5a-2757-43eb-91c8-1985f18ef6c2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:34.324066 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-a41e2b5a-2757-43eb-91c8-1985f18ef6c2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:34.330074 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a41e2b5a-2757-43eb-91c8-1985f18ef6c2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:34.330531 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a41e2b5a-2757-43eb-91c8-1985f18ef6c2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:34.331289 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a41e2b5a-2757-43eb-91c8-1985f18ef6c2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:34.331835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a41e2b5a-2757-43eb-91c8-1985f18ef6c2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:34.460913 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-a41e2b5a-2757-43eb-91c8-1985f18ef6c2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:34.468470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-a41e2b5a-2757-43eb-91c8-1985f18ef6c2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1510 microversion: 2.1 time: 0.148832 Jul 26 12:53:34.469035 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 129/264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:34 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:34.852303 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-11a908be-a556-494f-bcfc-7e28ba0dcc71 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:34.852903 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-11a908be-a556-494f-bcfc-7e28ba0dcc71 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:34.858831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-11a908be-a556-494f-bcfc-7e28ba0dcc71 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:34.859279 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-11a908be-a556-494f-bcfc-7e28ba0dcc71 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:34.860075 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-11a908be-a556-494f-bcfc-7e28ba0dcc71 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:34.860520 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-11a908be-a556-494f-bcfc-7e28ba0dcc71 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:34.989503 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-11a908be-a556-494f-bcfc-7e28ba0dcc71 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:35.002893 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-11a908be-a556-494f-bcfc-7e28ba0dcc71 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:35.005913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-11a908be-a556-494f-bcfc-7e28ba0dcc71 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:35.007759 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-11a908be-a556-494f-bcfc-7e28ba0dcc71 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.159039 Jul 26 12:53:35.008496 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 136/265] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:34 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:35.027770 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8bf0c3cf-611b-4b4d-b993-b0a7996b5ea6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:35.028622 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8bf0c3cf-611b-4b4d-b993-b0a7996b5ea6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:35.035218 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8bf0c3cf-611b-4b4d-b993-b0a7996b5ea6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:35.035703 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8bf0c3cf-611b-4b4d-b993-b0a7996b5ea6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:35.036483 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8bf0c3cf-611b-4b4d-b993-b0a7996b5ea6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:35.036923 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8bf0c3cf-611b-4b4d-b993-b0a7996b5ea6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:35.209228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8bf0c3cf-611b-4b4d-b993-b0a7996b5ea6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:35.216527 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8bf0c3cf-611b-4b4d-b993-b0a7996b5ea6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1319 microversion: 2.1 time: 0.193002 Jul 26 12:53:35.217102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 130/266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:35 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:35.310133 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-cccc102f-c182-4697-94f6-72cbeecf468f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:35.310724 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-cccc102f-c182-4697-94f6-72cbeecf468f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:35.316649 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cccc102f-c182-4697-94f6-72cbeecf468f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:35.317088 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cccc102f-c182-4697-94f6-72cbeecf468f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:35.318468 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cccc102f-c182-4697-94f6-72cbeecf468f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:35.318893 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cccc102f-c182-4697-94f6-72cbeecf468f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:35.410540 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-26f488db-a32e-42d2-a9f5-9aa29808b24d req-dbd87199-e822-4bce-8a7e-ae1845ffb992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf15f1d-311d-4b62-a80c-6668706d2a67", "tag": "9b013626-dcc3-4a6a-84ce-6c100ca71a7e"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:35.420472 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-26f488db-a32e-42d2-a9f5-9aa29808b24d req-dbd87199-e822-4bce-8a7e-ae1845ffb992 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:35.420904 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-26f488db-a32e-42d2-a9f5-9aa29808b24d req-dbd87199-e822-4bce-8a7e-ae1845ffb992 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:35.431831 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-26f488db-a32e-42d2-a9f5-9aa29808b24d req-dbd87199-e822-4bce-8a7e-ae1845ffb992 service nova] Creating event network-changed:9b013626-dcc3-4a6a-84ce-6c100ca71a7e for instance dbf15f1d-311d-4b62-a80c-6668706d2a67 on hv-cinder-85093 Jul 26 12:53:35.436495 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-26f488db-a32e-42d2-a9f5-9aa29808b24d req-dbd87199-e822-4bce-8a7e-ae1845ffb992 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029487 Jul 26 12:53:35.437082 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 131/267] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:53:35.450043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-cccc102f-c182-4697-94f6-72cbeecf468f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:35.457465 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-cccc102f-c182-4697-94f6-72cbeecf468f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.151201 Jul 26 12:53:35.458034 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 137/268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:35 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:35.491141 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d9433ee3-3cf6-4061-a4c2-850e20b280d3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:35.491867 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d9433ee3-3cf6-4061-a4c2-850e20b280d3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:35.498014 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d9433ee3-3cf6-4061-a4c2-850e20b280d3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:35.498469 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d9433ee3-3cf6-4061-a4c2-850e20b280d3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:35.499233 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d9433ee3-3cf6-4061-a4c2-850e20b280d3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:35.499985 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d9433ee3-3cf6-4061-a4c2-850e20b280d3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:35.630285 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d9433ee3-3cf6-4061-a4c2-850e20b280d3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:35.638237 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d9433ee3-3cf6-4061-a4c2-850e20b280d3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1516 microversion: 2.1 time: 0.151743 Jul 26 12:53:35.638847 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 132/269] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:35 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:36.033857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ab46576a-254e-449e-b910-ffd1edfd39cc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:36.034473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ab46576a-254e-449e-b910-ffd1edfd39cc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:36.042196 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ab46576a-254e-449e-b910-ffd1edfd39cc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:36.042652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ab46576a-254e-449e-b910-ffd1edfd39cc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:36.043452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ab46576a-254e-449e-b910-ffd1edfd39cc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:36.043917 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ab46576a-254e-449e-b910-ffd1edfd39cc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:36.127245 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:36.175512 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ab46576a-254e-449e-b910-ffd1edfd39cc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:36.183786 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ab46576a-254e-449e-b910-ffd1edfd39cc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:36.185279 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ab46576a-254e-449e-b910-ffd1edfd39cc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:36.186426 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ab46576a-254e-449e-b910-ffd1edfd39cc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.156672 Jul 26 12:53:36.187003 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 138/270] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:36 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:36.237296 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-816148d0-1232-4aed-8892-4752889bb1b0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:36.237914 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-816148d0-1232-4aed-8892-4752889bb1b0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:36.240770 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=2 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:36.246970 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-816148d0-1232-4aed-8892-4752889bb1b0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:36.247571 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-816148d0-1232-4aed-8892-4752889bb1b0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:36.248379 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-816148d0-1232-4aed-8892-4752889bb1b0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:36.248865 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-816148d0-1232-4aed-8892-4752889bb1b0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:36.432337 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-816148d0-1232-4aed-8892-4752889bb1b0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:36.440679 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-816148d0-1232-4aed-8892-4752889bb1b0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1319 microversion: 2.1 time: 0.207361 Jul 26 12:53:36.441621 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 133/271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:36 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:36.478405 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8500e5d6-5576-40c0-bd01-60797e144c4a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:36.479028 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8500e5d6-5576-40c0-bd01-60797e144c4a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:36.485773 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8500e5d6-5576-40c0-bd01-60797e144c4a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:36.486185 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8500e5d6-5576-40c0-bd01-60797e144c4a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:36.486983 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8500e5d6-5576-40c0-bd01-60797e144c4a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:36.487419 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8500e5d6-5576-40c0-bd01-60797e144c4a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:36.607606 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=8 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:36.627429 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8500e5d6-5576-40c0-bd01-60797e144c4a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:36.636324 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8500e5d6-5576-40c0-bd01-60797e144c4a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.161830 Jul 26 12:53:36.636901 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 139/272] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:36 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:37.025370 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f815d42d-a1e0-481a-92cd-818445436b76 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Action: 'create', calling method: .version_select at 0x7f65f54181f0>, body: {"keypair": {"name": "tempest-keypair-1660952901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANenXisFeh68cVdDqSpDhu+v5cf54SsILFFNuSoWUGmkqlWoE4KwL+lsk2wIC7ox8NvwEIfnlD0+1lhs7eq6GkWldeM5SDXBJebLu5kX0XS0SoqE5To5W3MGtVynZpf/A=="}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:37.032724 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=8 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:37.056354 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-f815d42d-a1e0-481a-92cd-818445436b76 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Getting quotas for project d92bfe73c0a54823a88a89f9ae627134. Resources: {'key_pairs'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:53:37.061614 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-f815d42d-a1e0-481a-92cd-818445436b76 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Getting quotas for user 2b5894762d4b4cc99521bc224d2bddd7 and project d92bfe73c0a54823a88a89f9ae627134. Resources: {'key_pairs'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:53:37.089754 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f815d42d-a1e0-481a-92cd-818445436b76 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068231 Jul 26 12:53:37.096447 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 134/273] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Jul 26 12:53:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:53:37.156009 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7cc1a527-b53d-4801-a9d5-51dfa4199cc9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Action: 'create', calling method: .version_select at 0x7f65f54cfd30>, body: {"keypair": {"name": "tempest-keypair-990042912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8vMzV+EDoqzq/oQlY/41BYVxGnzqDernpLYlU65hRbch6+CJs2kIdd3xPRi42GYrSykBoBQ2HnO0Yr+502l8uxIm9hx4u4TKM7UOVHXv18eX23GOjpBgaKeCLg7hKECw=="}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:37.177948 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-7cc1a527-b53d-4801-a9d5-51dfa4199cc9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for project 01fca015df86428b9356df3f127327c2. Resources: {'key_pairs'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:53:37.182359 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-7cc1a527-b53d-4801-a9d5-51dfa4199cc9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for user 1401efb776ab424e8ff4f09eac33d92f and project 01fca015df86428b9356df3f127327c2. Resources: {'key_pairs'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:53:37.210447 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-29cc4ee2-9422-42eb-a2f1-63e85df3806b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:37.211060 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-29cc4ee2-9422-42eb-a2f1-63e85df3806b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:37.215508 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7cc1a527-b53d-4801-a9d5-51dfa4199cc9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065135 Jul 26 12:53:37.222533 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 140/274] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Jul 26 12:53:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:53:37.225475 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-29cc4ee2-9422-42eb-a2f1-63e85df3806b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:37.226163 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-29cc4ee2-9422-42eb-a2f1-63e85df3806b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:37.227199 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-29cc4ee2-9422-42eb-a2f1-63e85df3806b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:37.227897 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-29cc4ee2-9422-42eb-a2f1-63e85df3806b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:37.230994 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:37.422145 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-29cc4ee2-9422-42eb-a2f1-63e85df3806b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:37.430698 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-29cc4ee2-9422-42eb-a2f1-63e85df3806b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:37.432264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-29cc4ee2-9422-42eb-a2f1-63e85df3806b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:37.433429 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-29cc4ee2-9422-42eb-a2f1-63e85df3806b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.227761 Jul 26 12:53:37.434006 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 135/275] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:37 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:37.526271 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a60c3e58-e6de-4343-86f3-29e23560d596 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:37.527522 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-a60c3e58-e6de-4343-86f3-29e23560d596 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:37.540180 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a60c3e58-e6de-4343-86f3-29e23560d596 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:37.540634 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a60c3e58-e6de-4343-86f3-29e23560d596 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:37.544256 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a60c3e58-e6de-4343-86f3-29e23560d596 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:37.544726 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a60c3e58-e6de-4343-86f3-29e23560d596 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:37.660842 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-65e73b1a-2aa9-4496-ac96-2f25bee48506 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:37.661870 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-65e73b1a-2aa9-4496-ac96-2f25bee48506 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:37.669422 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-65e73b1a-2aa9-4496-ac96-2f25bee48506 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:37.669955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-65e73b1a-2aa9-4496-ac96-2f25bee48506 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:37.670805 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-65e73b1a-2aa9-4496-ac96-2f25bee48506 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:37.671306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-65e73b1a-2aa9-4496-ac96-2f25bee48506 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:37.773044 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-a60c3e58-e6de-4343-86f3-29e23560d596 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:37.787108 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a60c3e58-e6de-4343-86f3-29e23560d596 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1319 microversion: 2.1 time: 0.265249 Jul 26 12:53:37.788477 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 141/276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:37 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:37.883230 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-65e73b1a-2aa9-4496-ac96-2f25bee48506 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:37.892460 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-65e73b1a-2aa9-4496-ac96-2f25bee48506 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.237659 Jul 26 12:53:37.893051 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 136/277] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:37 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:38.468376 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5839b666-cfef-442a-bb2b-3673003724e8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:38.474777 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-5839b666-cfef-442a-bb2b-3673003724e8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:38.484227 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5839b666-cfef-442a-bb2b-3673003724e8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:38.484924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5839b666-cfef-442a-bb2b-3673003724e8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:38.486305 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5839b666-cfef-442a-bb2b-3673003724e8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:38.487169 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5839b666-cfef-442a-bb2b-3673003724e8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:38.745577 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-5839b666-cfef-442a-bb2b-3673003724e8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:38.755526 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-5839b666-cfef-442a-bb2b-3673003724e8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:38.757175 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-5839b666-cfef-442a-bb2b-3673003724e8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:38.758407 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-5839b666-cfef-442a-bb2b-3673003724e8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.305685 Jul 26 12:53:38.759041 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 142/278] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:38 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:38.809134 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-35ec38bb-ad6a-44f8-9625-b622e9901ac2 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:38.809818 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-35ec38bb-ad6a-44f8-9625-b622e9901ac2 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:38.818061 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35ec38bb-ad6a-44f8-9625-b622e9901ac2 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:38.818606 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35ec38bb-ad6a-44f8-9625-b622e9901ac2 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:38.819674 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35ec38bb-ad6a-44f8-9625-b622e9901ac2 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:38.820173 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35ec38bb-ad6a-44f8-9625-b622e9901ac2 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:38.862933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-594145468", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "399a1d18-4e78-4e8a-8ddb-7b454af2918b"}], "security_groups": [{"name": "tempest-securitygroup--24827052"}], "key_name": "tempest-keypair-1660952901", "user_data": "}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:38.978361 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.network.neutron [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] validate_networks() for [('399a1d18-4e78-4e8a-8ddb-7b454af2918b', None, None, None, None, None)] {{(pid=129308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:53:39.024451 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-35ec38bb-ad6a-44f8-9625-b622e9901ac2 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:39.037285 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-35ec38bb-ad6a-44f8-9625-b622e9901ac2 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1319 microversion: 2.1 time: 0.231247 Jul 26 12:53:39.037872 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 137/279] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:38 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:39.054269 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-016df8e8-d7ac-4e2b-96cf-d421482b21f0 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:39.055026 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-016df8e8-d7ac-4e2b-96cf-d421482b21f0 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:39.061818 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-016df8e8-d7ac-4e2b-96cf-d421482b21f0 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:39.062591 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-016df8e8-d7ac-4e2b-96cf-d421482b21f0 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:39.063442 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-016df8e8-d7ac-4e2b-96cf-d421482b21f0 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:39.064096 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-016df8e8-d7ac-4e2b-96cf-d421482b21f0 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:39.352827 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-016df8e8-d7ac-4e2b-96cf-d421482b21f0 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:39.361140 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-016df8e8-d7ac-4e2b-96cf-d421482b21f0 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.318584 Jul 26 12:53:39.361719 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 138/280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:39 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:39.367718 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1229757189", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "923d9432-be57-465d-9c21-1d0c5b4c37d3"}], "security_groups": [{"name": "tempest-securitygroup--1987282422"}], "key_name": "tempest-keypair-990042912", "user_data": "}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:39.412925 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Flavor limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:53:39.413336 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Image limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:53:39.413827 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Flavor pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:53:39.414229 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Image pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:53:39.414660 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:53:39.425300 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:39.425300 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:39.425864 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:39.426291 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:39.449582 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Getting quotas for project d92bfe73c0a54823a88a89f9ae627134. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:53:39.453571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Getting quotas for user 2b5894762d4b4cc99521bc224d2bddd7 and project d92bfe73c0a54823a88a89f9ae627134. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:53:39.465721 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Going to run 1 instances... {{(pid=129308) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:53:39.467992 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:53:39.516110 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-57d1191c-69e7-4721-bfd2-a6b176db8099 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.657437 Jul 26 12:53:39.517061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 143/281] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:53:38 2022] POST /compute/v2.1/servers => generated 407 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 12:53:39.526913 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.network.neutron [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] validate_networks() for [('923d9432-be57-465d-9c21-1d0c5b4c37d3', None, None, None, None, None)] {{(pid=129307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:53:39.530499 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-63162e1b-be38-4948-83ea-0a69dbf6f4bd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:39.531115 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-63162e1b-be38-4948-83ea-0a69dbf6f4bd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:39.588233 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-63162e1b-be38-4948-83ea-0a69dbf6f4bd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:39.597460 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-63162e1b-be38-4948-83ea-0a69dbf6f4bd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1245 microversion: 2.1 time: 0.071781 Jul 26 12:53:39.597644 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 144/282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:39 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:39.784655 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1d4141f2-a1d5-4851-a85a-e220ca7feffd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:39.785310 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1d4141f2-a1d5-4851-a85a-e220ca7feffd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:39.787721 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:39.798307 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1d4141f2-a1d5-4851-a85a-e220ca7feffd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:39.798811 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1d4141f2-a1d5-4851-a85a-e220ca7feffd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:39.799578 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1d4141f2-a1d5-4851-a85a-e220ca7feffd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:39.800238 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1d4141f2-a1d5-4851-a85a-e220ca7feffd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:40.007931 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1d4141f2-a1d5-4851-a85a-e220ca7feffd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:40.019836 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1d4141f2-a1d5-4851-a85a-e220ca7feffd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:40.021982 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1d4141f2-a1d5-4851-a85a-e220ca7feffd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:40.023510 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1d4141f2-a1d5-4851-a85a-e220ca7feffd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.244799 Jul 26 12:53:40.024668 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 145/283] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:39 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:40.057777 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-cdadb844-6749-4276-8bd5-44578354facf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:40.059106 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-cdadb844-6749-4276-8bd5-44578354facf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:40.067923 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cdadb844-6749-4276-8bd5-44578354facf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:40.069099 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cdadb844-6749-4276-8bd5-44578354facf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:40.070217 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cdadb844-6749-4276-8bd5-44578354facf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:40.070598 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cdadb844-6749-4276-8bd5-44578354facf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:40.290651 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-cdadb844-6749-4276-8bd5-44578354facf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:40.302311 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-cdadb844-6749-4276-8bd5-44578354facf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1319 microversion: 2.1 time: 0.248290 Jul 26 12:53:40.303221 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 146/284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:40 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:40.383570 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f9c5eb70-4618-415f-88ed-973f8be677a7 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:40.384217 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f9c5eb70-4618-415f-88ed-973f8be677a7 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:40.390351 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f9c5eb70-4618-415f-88ed-973f8be677a7 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:40.391039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f9c5eb70-4618-415f-88ed-973f8be677a7 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:40.392036 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f9c5eb70-4618-415f-88ed-973f8be677a7 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:40.392653 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f9c5eb70-4618-415f-88ed-973f8be677a7 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:40.538104 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f9c5eb70-4618-415f-88ed-973f8be677a7 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:40.545562 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f9c5eb70-4618-415f-88ed-973f8be677a7 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.166482 Jul 26 12:53:40.546129 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 147/285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:40 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:40.617846 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-dde2cd0b-877a-4065-aae6-939b828f1f3f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:40.618460 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-dde2cd0b-877a-4065-aae6-939b828f1f3f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:40.624995 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dde2cd0b-877a-4065-aae6-939b828f1f3f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:40.625444 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dde2cd0b-877a-4065-aae6-939b828f1f3f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:40.626228 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dde2cd0b-877a-4065-aae6-939b828f1f3f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:40.626658 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dde2cd0b-877a-4065-aae6-939b828f1f3f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:40.691211 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-dde2cd0b-877a-4065-aae6-939b828f1f3f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:40.699727 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-dde2cd0b-877a-4065-aae6-939b828f1f3f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1297 microversion: 2.1 time: 0.085626 Jul 26 12:53:40.700311 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 148/286] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:40 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:40.924587 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Flavor limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:53:40.925547 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Image limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:53:40.926223 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Flavor pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:53:40.926708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Image pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:53:40.927361 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:53:40.936709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:40.937247 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:40.938112 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:40.938621 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:40.956500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for project 01fca015df86428b9356df3f127327c2. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:53:40.961173 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for user 1401efb776ab424e8ff4f09eac33d92f and project 01fca015df86428b9356df3f127327c2. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:53:40.973033 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Going to run 1 instances... {{(pid=129307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:53:40.975915 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:53:41.022334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-be9ca190-3e5b-4601-b831-144b26f7fda2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.659468 Jul 26 12:53:41.022912 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 139/287] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:53:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 12:53:41.033757 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a2c9052a-f0eb-4c50-9f1a-a42c821079db tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:41.034303 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-a2c9052a-f0eb-4c50-9f1a-a42c821079db tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:41.048059 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f2b91bcb-387a-470f-ae25-4a4b29ee9750 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:41.048697 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f2b91bcb-387a-470f-ae25-4a4b29ee9750 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:41.056656 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f2b91bcb-387a-470f-ae25-4a4b29ee9750 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:41.057039 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f2b91bcb-387a-470f-ae25-4a4b29ee9750 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:41.057981 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f2b91bcb-387a-470f-ae25-4a4b29ee9750 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:41.058426 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f2b91bcb-387a-470f-ae25-4a4b29ee9750 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:41.091231 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-a2c9052a-f0eb-4c50-9f1a-a42c821079db tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:41.098733 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a2c9052a-f0eb-4c50-9f1a-a42c821079db tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1241 microversion: 2.1 time: 0.068665 Jul 26 12:53:41.099303 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 149/288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:41 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:41.213099 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f2b91bcb-387a-470f-ae25-4a4b29ee9750 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:41.221418 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f2b91bcb-387a-470f-ae25-4a4b29ee9750 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:41.223156 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f2b91bcb-387a-470f-ae25-4a4b29ee9750 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:41.225460 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f2b91bcb-387a-470f-ae25-4a4b29ee9750 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.180550 Jul 26 12:53:41.226034 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 140/289] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:41 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:53:41.322895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8d121bf4-0a64-483c-94e4-dc3ce6714bd3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:41.323778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8d121bf4-0a64-483c-94e4-dc3ce6714bd3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:41.329920 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8d121bf4-0a64-483c-94e4-dc3ce6714bd3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:41.330368 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8d121bf4-0a64-483c-94e4-dc3ce6714bd3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:41.331129 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8d121bf4-0a64-483c-94e4-dc3ce6714bd3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:41.331570 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8d121bf4-0a64-483c-94e4-dc3ce6714bd3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:41.468616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8d121bf4-0a64-483c-94e4-dc3ce6714bd3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:41.477132 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8d121bf4-0a64-483c-94e4-dc3ce6714bd3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1319 microversion: 2.1 time: 0.158096 Jul 26 12:53:41.477698 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 150/290] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:41 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:41.565874 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-266fd84f-1a05-4849-a5f2-330a3b14514f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:41.566469 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-266fd84f-1a05-4849-a5f2-330a3b14514f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:41.568831 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:41.574167 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-266fd84f-1a05-4849-a5f2-330a3b14514f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:41.574542 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-266fd84f-1a05-4849-a5f2-330a3b14514f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:41.575326 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-266fd84f-1a05-4849-a5f2-330a3b14514f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:41.575782 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-266fd84f-1a05-4849-a5f2-330a3b14514f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:41.707534 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-266fd84f-1a05-4849-a5f2-330a3b14514f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:41.715441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-266fd84f-1a05-4849-a5f2-330a3b14514f tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.153454 Jul 26 12:53:41.728505 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 141/291] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:41 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:41.728706 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-aab0fc28-3428-4921-ae90-24bfbfb8458c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:41.728706 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-aab0fc28-3428-4921-ae90-24bfbfb8458c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:41.728947 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aab0fc28-3428-4921-ae90-24bfbfb8458c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:41.729392 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aab0fc28-3428-4921-ae90-24bfbfb8458c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:41.730139 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aab0fc28-3428-4921-ae90-24bfbfb8458c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:41.730566 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aab0fc28-3428-4921-ae90-24bfbfb8458c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:41.792388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-aab0fc28-3428-4921-ae90-24bfbfb8458c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:41.799745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-aab0fc28-3428-4921-ae90-24bfbfb8458c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1303 microversion: 2.1 time: 0.081742 Jul 26 12:53:41.800375 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 151/292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:41 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1303 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:42.120319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-eca670f5-3b01-417c-b7e9-9bab890eb057 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:42.120867 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-eca670f5-3b01-417c-b7e9-9bab890eb057 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:42.127668 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eca670f5-3b01-417c-b7e9-9bab890eb057 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:42.128117 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eca670f5-3b01-417c-b7e9-9bab890eb057 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:42.128913 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eca670f5-3b01-417c-b7e9-9bab890eb057 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:42.129344 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eca670f5-3b01-417c-b7e9-9bab890eb057 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:42.189674 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-eca670f5-3b01-417c-b7e9-9bab890eb057 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:42.198210 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-eca670f5-3b01-417c-b7e9-9bab890eb057 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1245 microversion: 2.1 time: 0.081774 Jul 26 12:53:42.198789 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 142/293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:42 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:42.250390 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c7b1ead9-e497-44c4-86fc-4cce5facadda tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:42.251028 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c7b1ead9-e497-44c4-86fc-4cce5facadda tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:42.257769 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c7b1ead9-e497-44c4-86fc-4cce5facadda tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:42.258221 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c7b1ead9-e497-44c4-86fc-4cce5facadda tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:42.258985 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c7b1ead9-e497-44c4-86fc-4cce5facadda tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:42.259421 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c7b1ead9-e497-44c4-86fc-4cce5facadda tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:42.263264 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=100 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:42.388222 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c7b1ead9-e497-44c4-86fc-4cce5facadda tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:42.396689 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c7b1ead9-e497-44c4-86fc-4cce5facadda tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:42.398214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c7b1ead9-e497-44c4-86fc-4cce5facadda tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:42.399368 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c7b1ead9-e497-44c4-86fc-4cce5facadda tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.153125 Jul 26 12:53:42.399956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 152/294] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:42 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:42.498265 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-661f21ac-ea90-4fa5-a2e8-168bdd26147b tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:42.498885 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-661f21ac-ea90-4fa5-a2e8-168bdd26147b tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:42.505643 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-661f21ac-ea90-4fa5-a2e8-168bdd26147b tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:42.506098 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-661f21ac-ea90-4fa5-a2e8-168bdd26147b tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:42.506864 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-661f21ac-ea90-4fa5-a2e8-168bdd26147b tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:42.507305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-661f21ac-ea90-4fa5-a2e8-168bdd26147b tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:42.639661 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-661f21ac-ea90-4fa5-a2e8-168bdd26147b tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:42.647864 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-661f21ac-ea90-4fa5-a2e8-168bdd26147b tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1319 microversion: 2.1 time: 0.153392 Jul 26 12:53:42.648442 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 143/295] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:42 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:42.736250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d6f9eea3-a983-4f53-b02f-f9fa8efa7ed9 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:42.736863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d6f9eea3-a983-4f53-b02f-f9fa8efa7ed9 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:42.743487 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d6f9eea3-a983-4f53-b02f-f9fa8efa7ed9 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:42.743978 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d6f9eea3-a983-4f53-b02f-f9fa8efa7ed9 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:42.744733 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d6f9eea3-a983-4f53-b02f-f9fa8efa7ed9 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:42.745162 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d6f9eea3-a983-4f53-b02f-f9fa8efa7ed9 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:42.821524 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-66a1614c-4ad4-41c8-b84e-4821aeac2e1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:42.822054 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-66a1614c-4ad4-41c8-b84e-4821aeac2e1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:42.828271 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-66a1614c-4ad4-41c8-b84e-4821aeac2e1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:42.828713 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-66a1614c-4ad4-41c8-b84e-4821aeac2e1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:42.829467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-66a1614c-4ad4-41c8-b84e-4821aeac2e1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:42.829891 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-66a1614c-4ad4-41c8-b84e-4821aeac2e1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:42.879548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d6f9eea3-a983-4f53-b02f-f9fa8efa7ed9 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:42.887647 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d6f9eea3-a983-4f53-b02f-f9fa8efa7ed9 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.155300 Jul 26 12:53:42.888183 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 153/296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:42 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:42.893654 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-66a1614c-4ad4-41c8-b84e-4821aeac2e1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:42.901158 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-66a1614c-4ad4-41c8-b84e-4821aeac2e1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1303 microversion: 2.1 time: 0.084147 Jul 26 12:53:42.901721 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 144/297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:42 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1303 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:43.219364 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-4cecd169-7e07-4176-9980-81297f5b3c69 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:43.220012 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-4cecd169-7e07-4176-9980-81297f5b3c69 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:43.226624 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4cecd169-7e07-4176-9980-81297f5b3c69 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:43.227082 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4cecd169-7e07-4176-9980-81297f5b3c69 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:43.227880 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4cecd169-7e07-4176-9980-81297f5b3c69 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:43.228316 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4cecd169-7e07-4176-9980-81297f5b3c69 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:43.421954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-4cecd169-7e07-4176-9980-81297f5b3c69 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:43.422966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-587cd8d7-a71a-448b-8093-49795bfb111b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:43.423572 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-587cd8d7-a71a-448b-8093-49795bfb111b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:43.430411 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-587cd8d7-a71a-448b-8093-49795bfb111b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:43.430611 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-4cecd169-7e07-4176-9980-81297f5b3c69 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1245 microversion: 2.1 time: 0.214903 Jul 26 12:53:43.430856 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-587cd8d7-a71a-448b-8093-49795bfb111b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:43.438846 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 154/298] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:43 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1245 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:43.438996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-587cd8d7-a71a-448b-8093-49795bfb111b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:43.438996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-587cd8d7-a71a-448b-8093-49795bfb111b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:43.619742 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-8aafbbdf-8122-4d09-9a1b-9a7d9e398a35 req-e3ce25db-9f7a-476e-8b53-b08c7a207243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf15f1d-311d-4b62-a80c-6668706d2a67", "name": "network-vif-plugged", "status": "completed", "tag": "9b013626-dcc3-4a6a-84ce-6c100ca71a7e"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:43.630948 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-8aafbbdf-8122-4d09-9a1b-9a7d9e398a35 req-e3ce25db-9f7a-476e-8b53-b08c7a207243 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:43.631525 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-8aafbbdf-8122-4d09-9a1b-9a7d9e398a35 req-e3ce25db-9f7a-476e-8b53-b08c7a207243 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:43.645931 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-587cd8d7-a71a-448b-8093-49795bfb111b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:43.646292 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-8aafbbdf-8122-4d09-9a1b-9a7d9e398a35 req-e3ce25db-9f7a-476e-8b53-b08c7a207243 service nova] Creating event network-vif-plugged:9b013626-dcc3-4a6a-84ce-6c100ca71a7e for instance dbf15f1d-311d-4b62-a80c-6668706d2a67 on hv-cinder-85093 Jul 26 12:53:43.652631 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-8aafbbdf-8122-4d09-9a1b-9a7d9e398a35 req-e3ce25db-9f7a-476e-8b53-b08c7a207243 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036025 Jul 26 12:53:43.653273 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 155/299] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:53:43.659923 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-587cd8d7-a71a-448b-8093-49795bfb111b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:43.662824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-587cd8d7-a71a-448b-8093-49795bfb111b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:43.664653 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-587cd8d7-a71a-448b-8093-49795bfb111b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.246271 Jul 26 12:53:43.676183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 145/300] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:43 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:43.679310 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-caa90b56-5c74-451a-95ad-f97b671ce557 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:43.681259 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-caa90b56-5c74-451a-95ad-f97b671ce557 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:43.690714 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-caa90b56-5c74-451a-95ad-f97b671ce557 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:43.691437 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-caa90b56-5c74-451a-95ad-f97b671ce557 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:43.693112 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-caa90b56-5c74-451a-95ad-f97b671ce557 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:43.693696 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-caa90b56-5c74-451a-95ad-f97b671ce557 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:43.875983 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-caa90b56-5c74-451a-95ad-f97b671ce557 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:43.888961 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-caa90b56-5c74-451a-95ad-f97b671ce557 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1319 microversion: 2.1 time: 0.219392 Jul 26 12:53:43.891129 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 156/301] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:43 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:43.911413 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1c4813cf-88a7-47f0-aee0-17dff94e9f7d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:43.912711 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1c4813cf-88a7-47f0-aee0-17dff94e9f7d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:43.922358 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3a08b7cd-a73b-4ffe-8fd7-8a1f2100187c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:43.923060 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3a08b7cd-a73b-4ffe-8fd7-8a1f2100187c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:43.935027 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a08b7cd-a73b-4ffe-8fd7-8a1f2100187c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:43.936625 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a08b7cd-a73b-4ffe-8fd7-8a1f2100187c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:43.937615 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1c4813cf-88a7-47f0-aee0-17dff94e9f7d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:43.938951 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1c4813cf-88a7-47f0-aee0-17dff94e9f7d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:43.939311 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a08b7cd-a73b-4ffe-8fd7-8a1f2100187c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:43.940947 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a08b7cd-a73b-4ffe-8fd7-8a1f2100187c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:43.942406 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1c4813cf-88a7-47f0-aee0-17dff94e9f7d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:43.943176 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1c4813cf-88a7-47f0-aee0-17dff94e9f7d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:44.042967 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3a08b7cd-a73b-4ffe-8fd7-8a1f2100187c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:44.052424 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3a08b7cd-a73b-4ffe-8fd7-8a1f2100187c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1303 microversion: 2.1 time: 0.133669 Jul 26 12:53:44.066051 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 157/302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:43 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1303 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:44.110258 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1c4813cf-88a7-47f0-aee0-17dff94e9f7d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:44.119367 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1c4813cf-88a7-47f0-aee0-17dff94e9f7d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.213587 Jul 26 12:53:44.120336 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 146/303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:43 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:44.450467 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e9d694aa-9b5a-4d89-aad9-2b21a653ad9d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:44.451084 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e9d694aa-9b5a-4d89-aad9-2b21a653ad9d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:44.457459 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e9d694aa-9b5a-4d89-aad9-2b21a653ad9d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:44.457913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e9d694aa-9b5a-4d89-aad9-2b21a653ad9d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:44.458690 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e9d694aa-9b5a-4d89-aad9-2b21a653ad9d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:44.459128 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e9d694aa-9b5a-4d89-aad9-2b21a653ad9d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:44.547076 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e9d694aa-9b5a-4d89-aad9-2b21a653ad9d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:44.556710 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e9d694aa-9b5a-4d89-aad9-2b21a653ad9d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1301 microversion: 2.1 time: 0.110209 Jul 26 12:53:44.571762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 158/304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:44 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1301 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:44.689744 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4ac76700-07c7-4f8f-92c4-fec10ee32614 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:44.691011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4ac76700-07c7-4f8f-92c4-fec10ee32614 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:44.701441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4ac76700-07c7-4f8f-92c4-fec10ee32614 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:44.702261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4ac76700-07c7-4f8f-92c4-fec10ee32614 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:44.703034 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4ac76700-07c7-4f8f-92c4-fec10ee32614 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:44.703877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4ac76700-07c7-4f8f-92c4-fec10ee32614 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:44.857204 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4ac76700-07c7-4f8f-92c4-fec10ee32614 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:44.865693 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4ac76700-07c7-4f8f-92c4-fec10ee32614 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:44.866935 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4ac76700-07c7-4f8f-92c4-fec10ee32614 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:44.868214 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4ac76700-07c7-4f8f-92c4-fec10ee32614 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.182878 Jul 26 12:53:44.868944 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 147/305] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:44 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:44.910531 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b6900d0c-a5df-4863-8cc2-8e1f6de9e387 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:44.911255 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b6900d0c-a5df-4863-8cc2-8e1f6de9e387 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:44.917423 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b6900d0c-a5df-4863-8cc2-8e1f6de9e387 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:44.917874 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b6900d0c-a5df-4863-8cc2-8e1f6de9e387 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:44.918638 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b6900d0c-a5df-4863-8cc2-8e1f6de9e387 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:44.919198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b6900d0c-a5df-4863-8cc2-8e1f6de9e387 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:45.074930 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f418dd9b-27fc-49c9-82c8-2a4727e0f392 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:45.075555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f418dd9b-27fc-49c9-82c8-2a4727e0f392 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:45.081779 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f418dd9b-27fc-49c9-82c8-2a4727e0f392 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:45.082230 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f418dd9b-27fc-49c9-82c8-2a4727e0f392 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:45.083032 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f418dd9b-27fc-49c9-82c8-2a4727e0f392 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:45.083827 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f418dd9b-27fc-49c9-82c8-2a4727e0f392 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:45.151746 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-b6900d0c-a5df-4863-8cc2-8e1f6de9e387 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:45.170388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b6900d0c-a5df-4863-8cc2-8e1f6de9e387 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1319 microversion: 2.1 time: 0.263768 Jul 26 12:53:45.171105 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 159/306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:44 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:45.177388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-457e008e-c2b7-48f4-9511-528d62d71f6b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:45.178873 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-457e008e-c2b7-48f4-9511-528d62d71f6b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:45.193872 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-457e008e-c2b7-48f4-9511-528d62d71f6b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:45.194424 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-457e008e-c2b7-48f4-9511-528d62d71f6b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:45.195312 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-457e008e-c2b7-48f4-9511-528d62d71f6b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:45.195899 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-457e008e-c2b7-48f4-9511-528d62d71f6b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:45.404534 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f418dd9b-27fc-49c9-82c8-2a4727e0f392 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:45.414425 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f418dd9b-27fc-49c9-82c8-2a4727e0f392 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1369 microversion: 2.1 time: 0.343559 Jul 26 12:53:45.418466 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 148/307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:45 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1369 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:45.424631 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-580a0b6f-e241-4a97-81ef-86e3f33e57d6 req-d017af73-c68d-4d08-aa71-db4a7f1538e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd47bdd7-0e5c-45eb-a6fb-979300251996", "tag": "0da5fda1-917d-45ee-bba6-4a249f129d9a"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:45.450080 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-580a0b6f-e241-4a97-81ef-86e3f33e57d6 req-d017af73-c68d-4d08-aa71-db4a7f1538e3 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:45.452096 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-580a0b6f-e241-4a97-81ef-86e3f33e57d6 req-d017af73-c68d-4d08-aa71-db4a7f1538e3 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:45.471584 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-457e008e-c2b7-48f4-9511-528d62d71f6b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:45.472946 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-580a0b6f-e241-4a97-81ef-86e3f33e57d6 req-d017af73-c68d-4d08-aa71-db4a7f1538e3 service nova] Creating event network-changed:0da5fda1-917d-45ee-bba6-4a249f129d9a for instance cd47bdd7-0e5c-45eb-a6fb-979300251996 on hv-cinder-85093 Jul 26 12:53:45.479116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-580a0b6f-e241-4a97-81ef-86e3f33e57d6 req-d017af73-c68d-4d08-aa71-db4a7f1538e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059265 Jul 26 12:53:45.479909 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 149/308] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:53:45.486325 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-457e008e-c2b7-48f4-9511-528d62d71f6b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.311391 Jul 26 12:53:45.488046 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 160/309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:45 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:45.584684 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ba775fc4-247a-47a8-95e4-cdee792cb138 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:45.585392 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ba775fc4-247a-47a8-95e4-cdee792cb138 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:45.599690 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ba775fc4-247a-47a8-95e4-cdee792cb138 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:45.600163 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ba775fc4-247a-47a8-95e4-cdee792cb138 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:45.605786 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ba775fc4-247a-47a8-95e4-cdee792cb138 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:45.612787 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ba775fc4-247a-47a8-95e4-cdee792cb138 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:45.710396 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ba775fc4-247a-47a8-95e4-cdee792cb138 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:45.719501 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ba775fc4-247a-47a8-95e4-cdee792cb138 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1299 microversion: 2.1 time: 0.144168 Jul 26 12:53:45.720795 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 150/310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:45 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:45.746936 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-04a6ce1e-38d2-4d63-9787-a54ebcd125c9 req-b1c13fbd-495e-4d48-98b5-f3adb486b132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc189b1-f457-4614-9639-b10131941960", "name": "network-vif-plugged", "status": "completed", "tag": "53cbdca1-deba-44f6-8b56-5b94884fd66d"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:45.762333 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-04a6ce1e-38d2-4d63-9787-a54ebcd125c9 req-b1c13fbd-495e-4d48-98b5-f3adb486b132 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:45.763206 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-04a6ce1e-38d2-4d63-9787-a54ebcd125c9 req-b1c13fbd-495e-4d48-98b5-f3adb486b132 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:45.778920 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-04a6ce1e-38d2-4d63-9787-a54ebcd125c9 req-b1c13fbd-495e-4d48-98b5-f3adb486b132 service nova] Creating event network-vif-plugged:53cbdca1-deba-44f6-8b56-5b94884fd66d for instance 9dc189b1-f457-4614-9639-b10131941960 on hv-cinder-85093 Jul 26 12:53:45.786646 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-04a6ce1e-38d2-4d63-9787-a54ebcd125c9 req-b1c13fbd-495e-4d48-98b5-f3adb486b132 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045026 Jul 26 12:53:45.788458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 161/311] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:53:45.905886 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e878b9d6-7a11-4699-ab51-810b194c0f24 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:45.906797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e878b9d6-7a11-4699-ab51-810b194c0f24 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:45.913413 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e878b9d6-7a11-4699-ab51-810b194c0f24 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:45.913929 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e878b9d6-7a11-4699-ab51-810b194c0f24 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:45.914927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e878b9d6-7a11-4699-ab51-810b194c0f24 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:45.915573 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e878b9d6-7a11-4699-ab51-810b194c0f24 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:46.177414 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e878b9d6-7a11-4699-ab51-810b194c0f24 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:46.196746 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0786d0ca-3131-4d6a-8b4c-63f6a9e9a7ab tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:46.197699 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0786d0ca-3131-4d6a-8b4c-63f6a9e9a7ab tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:46.202154 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e878b9d6-7a11-4699-ab51-810b194c0f24 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:46.209294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e878b9d6-7a11-4699-ab51-810b194c0f24 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:46.211219 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e878b9d6-7a11-4699-ab51-810b194c0f24 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1746 microversion: 2.20 time: 0.309855 Jul 26 12:53:46.212438 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0786d0ca-3131-4d6a-8b4c-63f6a9e9a7ab tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:46.213265 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0786d0ca-3131-4d6a-8b4c-63f6a9e9a7ab tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:46.214114 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 151/312] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:45 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1746 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:46.215682 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0786d0ca-3131-4d6a-8b4c-63f6a9e9a7ab tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:46.216347 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0786d0ca-3131-4d6a-8b4c-63f6a9e9a7ab tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:46.440378 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e48e1647-6236-4ac6-a424-719f5af7e1c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:46.442158 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e48e1647-6236-4ac6-a424-719f5af7e1c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:46.445217 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0786d0ca-3131-4d6a-8b4c-63f6a9e9a7ab tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:46.451753 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e48e1647-6236-4ac6-a424-719f5af7e1c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:46.452514 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e48e1647-6236-4ac6-a424-719f5af7e1c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:46.453606 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e48e1647-6236-4ac6-a424-719f5af7e1c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:46.454272 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e48e1647-6236-4ac6-a424-719f5af7e1c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:46.457591 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0786d0ca-3131-4d6a-8b4c-63f6a9e9a7ab tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1508 microversion: 2.1 time: 0.267191 Jul 26 12:53:46.467671 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 162/313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:46 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1508 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:46.513133 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3a1bc816-01b0-4a3f-946a-091a6a170a9d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:46.514484 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3a1bc816-01b0-4a3f-946a-091a6a170a9d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:46.523571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a1bc816-01b0-4a3f-946a-091a6a170a9d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:46.524065 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a1bc816-01b0-4a3f-946a-091a6a170a9d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:46.524853 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a1bc816-01b0-4a3f-946a-091a6a170a9d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:46.525295 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3a1bc816-01b0-4a3f-946a-091a6a170a9d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:46.731757 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3a1bc816-01b0-4a3f-946a-091a6a170a9d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:46.745480 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3a1bc816-01b0-4a3f-946a-091a6a170a9d tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.238668 Jul 26 12:53:46.746068 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 163/314] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:46 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:46.752306 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-af4529ad-6e72-4ea9-9227-b70cf93949dc tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:46.753374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-af4529ad-6e72-4ea9-9227-b70cf93949dc tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:46.763776 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-af4529ad-6e72-4ea9-9227-b70cf93949dc tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:46.764469 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-af4529ad-6e72-4ea9-9227-b70cf93949dc tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:46.765476 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-af4529ad-6e72-4ea9-9227-b70cf93949dc tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:46.766013 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-af4529ad-6e72-4ea9-9227-b70cf93949dc tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:46.785707 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e48e1647-6236-4ac6-a424-719f5af7e1c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:46.799820 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e48e1647-6236-4ac6-a424-719f5af7e1c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1369 microversion: 2.1 time: 0.365258 Jul 26 12:53:46.810522 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 152/315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:46 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1369 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:46.974538 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-af4529ad-6e72-4ea9-9227-b70cf93949dc tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:46.985637 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-af4529ad-6e72-4ea9-9227-b70cf93949dc tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1367 microversion: 2.1 time: 0.237397 Jul 26 12:53:46.986730 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 164/316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:46 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:47.207412 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-86c9723a-2ac1-499b-b5d9-863393185fb6 req-c8acf7e1-a6d4-4743-9e46-27cae8f6083e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa1010ce-5874-41a9-900d-cb5355c11d1b", "tag": "bcfd2cdd-0eb0-4f90-9350-81a2f6098d4e"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:47.226766 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-86c9723a-2ac1-499b-b5d9-863393185fb6 req-c8acf7e1-a6d4-4743-9e46-27cae8f6083e service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:47.233312 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-86c9723a-2ac1-499b-b5d9-863393185fb6 req-c8acf7e1-a6d4-4743-9e46-27cae8f6083e service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:47.239144 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c3e61f4c-995a-43b0-bd9c-5dc8e2438247 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:47.241507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=100 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:47.241800 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c3e61f4c-995a-43b0-bd9c-5dc8e2438247 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:47.253176 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-86c9723a-2ac1-499b-b5d9-863393185fb6 req-c8acf7e1-a6d4-4743-9e46-27cae8f6083e service nova] Creating event network-changed:bcfd2cdd-0eb0-4f90-9350-81a2f6098d4e for instance fa1010ce-5874-41a9-900d-cb5355c11d1b on hv-cinder-85093 Jul 26 12:53:47.253928 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c3e61f4c-995a-43b0-bd9c-5dc8e2438247 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:47.254385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c3e61f4c-995a-43b0-bd9c-5dc8e2438247 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:47.259695 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c3e61f4c-995a-43b0-bd9c-5dc8e2438247 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:47.260434 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-86c9723a-2ac1-499b-b5d9-863393185fb6 req-c8acf7e1-a6d4-4743-9e46-27cae8f6083e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062871 Jul 26 12:53:47.263916 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c3e61f4c-995a-43b0-bd9c-5dc8e2438247 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:47.264808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 153/317] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:53:47.421545 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c3e61f4c-995a-43b0-bd9c-5dc8e2438247 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:47.429885 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c3e61f4c-995a-43b0-bd9c-5dc8e2438247 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:47.431391 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c3e61f4c-995a-43b0-bd9c-5dc8e2438247 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:47.432588 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c3e61f4c-995a-43b0-bd9c-5dc8e2438247 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1746 microversion: 2.20 time: 0.198607 Jul 26 12:53:47.433133 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 165/318] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:47 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1746 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:53:47.767872 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8018dddc-8480-4197-8028-46d447518007 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:47.768585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8018dddc-8480-4197-8028-46d447518007 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:47.776028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8018dddc-8480-4197-8028-46d447518007 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:47.776982 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8018dddc-8480-4197-8028-46d447518007 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:47.778096 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8018dddc-8480-4197-8028-46d447518007 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:47.778549 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8018dddc-8480-4197-8028-46d447518007 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:47.827431 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8aa6eb6a-d159-4ff4-a7af-246883640ce4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:47.828061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8aa6eb6a-d159-4ff4-a7af-246883640ce4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:47.834478 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8aa6eb6a-d159-4ff4-a7af-246883640ce4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:47.834928 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8aa6eb6a-d159-4ff4-a7af-246883640ce4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:47.836106 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8aa6eb6a-d159-4ff4-a7af-246883640ce4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:47.836615 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8aa6eb6a-d159-4ff4-a7af-246883640ce4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:47.923599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8018dddc-8480-4197-8028-46d447518007 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:47.931753 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8018dddc-8480-4197-8028-46d447518007 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.168638 Jul 26 12:53:47.932429 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 154/319] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:47 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:47.978259 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8aa6eb6a-d159-4ff4-a7af-246883640ce4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:47.987418 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8aa6eb6a-d159-4ff4-a7af-246883640ce4 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1369 microversion: 2.1 time: 0.163611 Jul 26 12:53:47.988036 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 166/320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:47 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:48.013705 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-20db727f-4a4c-4bdd-b43f-fb5c82f74ca3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:48.014310 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-20db727f-4a4c-4bdd-b43f-fb5c82f74ca3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:48.020493 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20db727f-4a4c-4bdd-b43f-fb5c82f74ca3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:48.020944 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20db727f-4a4c-4bdd-b43f-fb5c82f74ca3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:48.021712 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20db727f-4a4c-4bdd-b43f-fb5c82f74ca3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:48.022145 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20db727f-4a4c-4bdd-b43f-fb5c82f74ca3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:48.161272 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-20db727f-4a4c-4bdd-b43f-fb5c82f74ca3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:48.169019 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-20db727f-4a4c-4bdd-b43f-fb5c82f74ca3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1367 microversion: 2.1 time: 0.160306 Jul 26 12:53:48.169588 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 155/321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:48 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:48.455779 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-2532756b-171c-4a6f-801c-5d61840aeb26 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:48.456309 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-2532756b-171c-4a6f-801c-5d61840aeb26 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:48.462433 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2532756b-171c-4a6f-801c-5d61840aeb26 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:48.462885 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2532756b-171c-4a6f-801c-5d61840aeb26 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:48.463673 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2532756b-171c-4a6f-801c-5d61840aeb26 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:48.464120 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2532756b-171c-4a6f-801c-5d61840aeb26 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:48.593027 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2532756b-171c-4a6f-801c-5d61840aeb26 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:48.602215 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2532756b-171c-4a6f-801c-5d61840aeb26 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:48.603765 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2532756b-171c-4a6f-801c-5d61840aeb26 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:48.604954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-2532756b-171c-4a6f-801c-5d61840aeb26 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1746 microversion: 2.20 time: 0.153214 Jul 26 12:53:48.605514 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 167/322] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:48 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:48.952166 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1d18e42b-5553-43d6-b584-bb623e444e46 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:48.952813 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1d18e42b-5553-43d6-b584-bb623e444e46 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:48.959869 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1d18e42b-5553-43d6-b584-bb623e444e46 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:48.960324 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1d18e42b-5553-43d6-b584-bb623e444e46 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:48.961092 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1d18e42b-5553-43d6-b584-bb623e444e46 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:48.961529 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1d18e42b-5553-43d6-b584-bb623e444e46 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:49.009581 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8633facc-8a14-4947-9e32-b8394a533e97 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:49.010265 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8633facc-8a14-4947-9e32-b8394a533e97 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:49.017181 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8633facc-8a14-4947-9e32-b8394a533e97 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:49.017668 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8633facc-8a14-4947-9e32-b8394a533e97 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:49.018447 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8633facc-8a14-4947-9e32-b8394a533e97 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:49.018891 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8633facc-8a14-4947-9e32-b8394a533e97 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:49.099663 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1d18e42b-5553-43d6-b584-bb623e444e46 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:49.107798 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1d18e42b-5553-43d6-b584-bb623e444e46 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.159401 Jul 26 12:53:49.108460 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 156/323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:48 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:49.153867 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8633facc-8a14-4947-9e32-b8394a533e97 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:49.161555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8633facc-8a14-4947-9e32-b8394a533e97 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1369 microversion: 2.1 time: 0.156000 Jul 26 12:53:49.162116 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 168/324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:49 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:49.190223 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c2cd8c7b-d65f-4450-9603-340a221cfbc8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:49.190867 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c2cd8c7b-d65f-4450-9603-340a221cfbc8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:49.197381 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c2cd8c7b-d65f-4450-9603-340a221cfbc8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:49.197832 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c2cd8c7b-d65f-4450-9603-340a221cfbc8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:49.198628 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c2cd8c7b-d65f-4450-9603-340a221cfbc8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:49.199018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c2cd8c7b-d65f-4450-9603-340a221cfbc8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:49.326332 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c2cd8c7b-d65f-4450-9603-340a221cfbc8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:49.333921 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c2cd8c7b-d65f-4450-9603-340a221cfbc8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1367 microversion: 2.1 time: 0.147526 Jul 26 12:53:49.334488 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 157/325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:49 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:49.628984 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-edbab963-e3bd-48f1-80ef-7ba053da6562 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:49.629516 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-edbab963-e3bd-48f1-80ef-7ba053da6562 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:49.632072 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:49.637599 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-edbab963-e3bd-48f1-80ef-7ba053da6562 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:49.638053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-edbab963-e3bd-48f1-80ef-7ba053da6562 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:49.638824 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-edbab963-e3bd-48f1-80ef-7ba053da6562 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:49.639293 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-edbab963-e3bd-48f1-80ef-7ba053da6562 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:49.765353 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-edbab963-e3bd-48f1-80ef-7ba053da6562 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:49.773969 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-edbab963-e3bd-48f1-80ef-7ba053da6562 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:49.775491 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-edbab963-e3bd-48f1-80ef-7ba053da6562 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:49.776834 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-edbab963-e3bd-48f1-80ef-7ba053da6562 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1746 microversion: 2.20 time: 0.152047 Jul 26 12:53:49.777418 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 169/326] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:49 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:50.128861 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6d91ed98-4df5-4fb7-bbb4-5bdec350dd93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:50.129475 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-6d91ed98-4df5-4fb7-bbb4-5bdec350dd93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:50.136095 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6d91ed98-4df5-4fb7-bbb4-5bdec350dd93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:50.136551 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6d91ed98-4df5-4fb7-bbb4-5bdec350dd93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:50.137319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6d91ed98-4df5-4fb7-bbb4-5bdec350dd93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:50.137766 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6d91ed98-4df5-4fb7-bbb4-5bdec350dd93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:50.182743 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-676df591-7c89-4870-9005-39e108af4fbf tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:50.183740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-676df591-7c89-4870-9005-39e108af4fbf tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:50.189895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-676df591-7c89-4870-9005-39e108af4fbf tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:50.190328 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-676df591-7c89-4870-9005-39e108af4fbf tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:50.191102 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-676df591-7c89-4870-9005-39e108af4fbf tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:50.191541 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-676df591-7c89-4870-9005-39e108af4fbf tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:50.194371 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=100 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:50.282314 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-6d91ed98-4df5-4fb7-bbb4-5bdec350dd93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:50.290528 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-6d91ed98-4df5-4fb7-bbb4-5bdec350dd93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.165610 Jul 26 12:53:50.290957 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 158/327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:50 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:50.328105 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-676df591-7c89-4870-9005-39e108af4fbf tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:50.335954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-676df591-7c89-4870-9005-39e108af4fbf tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1369 microversion: 2.1 time: 0.156916 Jul 26 12:53:50.336523 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 170/328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:50 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:50.354404 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ffec0c9e-b07a-4f22-83b6-5160f434207e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:50.355124 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ffec0c9e-b07a-4f22-83b6-5160f434207e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:50.366418 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ffec0c9e-b07a-4f22-83b6-5160f434207e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:50.367015 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ffec0c9e-b07a-4f22-83b6-5160f434207e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:50.368198 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ffec0c9e-b07a-4f22-83b6-5160f434207e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:50.368824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ffec0c9e-b07a-4f22-83b6-5160f434207e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:50.502013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ffec0c9e-b07a-4f22-83b6-5160f434207e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:50.510461 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ffec0c9e-b07a-4f22-83b6-5160f434207e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1367 microversion: 2.1 time: 0.160007 Jul 26 12:53:50.511068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 159/329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:50 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:50.800912 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a2c67215-acd4-43c4-b54e-b25d42ffed76 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:50.801426 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-a2c67215-acd4-43c4-b54e-b25d42ffed76 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:50.807457 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a2c67215-acd4-43c4-b54e-b25d42ffed76 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:50.807933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a2c67215-acd4-43c4-b54e-b25d42ffed76 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:50.808682 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a2c67215-acd4-43c4-b54e-b25d42ffed76 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:50.809108 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a2c67215-acd4-43c4-b54e-b25d42ffed76 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:50.952320 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-a2c67215-acd4-43c4-b54e-b25d42ffed76 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:50.962222 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-a2c67215-acd4-43c4-b54e-b25d42ffed76 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:50.963847 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-a2c67215-acd4-43c4-b54e-b25d42ffed76 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:50.965088 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a2c67215-acd4-43c4-b54e-b25d42ffed76 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1746 microversion: 2.20 time: 0.168272 Jul 26 12:53:50.965647 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 171/330] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:50 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:51.074243 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-6f1808bc-6bd9-437f-8880-972ac31e1615 req-9dc3b5cb-eb2b-4d71-8570-4050e1568783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20220b7e-2897-4f0c-98da-3f352aa39ec2", "name": "network-vif-plugged", "status": "completed", "tag": "32e67b58-c4c4-4a07-b551-08232595ea42"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:51.079398 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=2 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:51.080415 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=10 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:51.087393 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-6f1808bc-6bd9-437f-8880-972ac31e1615 req-9dc3b5cb-eb2b-4d71-8570-4050e1568783 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:51.087877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-6f1808bc-6bd9-437f-8880-972ac31e1615 req-9dc3b5cb-eb2b-4d71-8570-4050e1568783 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:51.100655 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-6f1808bc-6bd9-437f-8880-972ac31e1615 req-9dc3b5cb-eb2b-4d71-8570-4050e1568783 service nova] Creating event network-vif-plugged:32e67b58-c4c4-4a07-b551-08232595ea42 for instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 on hv-cinder-85093 Jul 26 12:53:51.106037 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-6f1808bc-6bd9-437f-8880-972ac31e1615 req-9dc3b5cb-eb2b-4d71-8570-4050e1568783 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036306 Jul 26 12:53:51.106638 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 160/331] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:53:51.313105 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-67eb280d-bd99-4843-8c40-86b0ebef5565 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:51.313802 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-67eb280d-bd99-4843-8c40-86b0ebef5565 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:51.315618 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=14 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:51.321219 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-67eb280d-bd99-4843-8c40-86b0ebef5565 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:51.321709 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-67eb280d-bd99-4843-8c40-86b0ebef5565 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:51.322474 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-67eb280d-bd99-4843-8c40-86b0ebef5565 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:51.322903 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-67eb280d-bd99-4843-8c40-86b0ebef5565 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:51.357172 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1945a74c-2ca0-4eb0-a80a-248a194012da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:51.358034 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1945a74c-2ca0-4eb0-a80a-248a194012da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:51.375298 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1945a74c-2ca0-4eb0-a80a-248a194012da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:51.376130 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1945a74c-2ca0-4eb0-a80a-248a194012da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:51.383493 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1945a74c-2ca0-4eb0-a80a-248a194012da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:51.384145 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1945a74c-2ca0-4eb0-a80a-248a194012da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:51.534474 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-67eb280d-bd99-4843-8c40-86b0ebef5565 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:51.544013 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-67eb280d-bd99-4843-8c40-86b0ebef5565 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1315 microversion: 2.1 time: 0.234671 Jul 26 12:53:51.546879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 172/332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:51 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:51.554830 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e940dace-1c72-4257-ab07-85ce0bb3c989 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:51.555668 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e940dace-1c72-4257-ab07-85ce0bb3c989 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:51.562062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e940dace-1c72-4257-ab07-85ce0bb3c989 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:51.562768 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e940dace-1c72-4257-ab07-85ce0bb3c989 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:51.563734 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e940dace-1c72-4257-ab07-85ce0bb3c989 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:51.564378 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e940dace-1c72-4257-ab07-85ce0bb3c989 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:51.684612 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1945a74c-2ca0-4eb0-a80a-248a194012da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:51.693945 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1945a74c-2ca0-4eb0-a80a-248a194012da tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1369 microversion: 2.1 time: 0.341334 Jul 26 12:53:51.698285 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 161/333] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:51 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1369 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:51.811227 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e940dace-1c72-4257-ab07-85ce0bb3c989 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:51.823506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e940dace-1c72-4257-ab07-85ce0bb3c989 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1367 microversion: 2.1 time: 0.272772 Jul 26 12:53:51.824004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 173/334] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:51 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:51.987740 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9203fceb-25b2-4912-8216-e5c1ead3e913 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:51.988357 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9203fceb-25b2-4912-8216-e5c1ead3e913 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:51.995685 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9203fceb-25b2-4912-8216-e5c1ead3e913 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:51.996134 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9203fceb-25b2-4912-8216-e5c1ead3e913 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:51.997167 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9203fceb-25b2-4912-8216-e5c1ead3e913 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:51.997412 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9203fceb-25b2-4912-8216-e5c1ead3e913 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:52.196227 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9203fceb-25b2-4912-8216-e5c1ead3e913 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:52.204876 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9203fceb-25b2-4912-8216-e5c1ead3e913 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:52.206697 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9203fceb-25b2-4912-8216-e5c1ead3e913 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:52.208073 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9203fceb-25b2-4912-8216-e5c1ead3e913 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1741 microversion: 2.20 time: 0.224201 Jul 26 12:53:52.208699 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 162/335] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:51 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:52.572326 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c246e68d-87c7-42bc-bf50-ce311a43ff93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:52.573980 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c246e68d-87c7-42bc-bf50-ce311a43ff93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:52.594151 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c246e68d-87c7-42bc-bf50-ce311a43ff93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:52.600458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c246e68d-87c7-42bc-bf50-ce311a43ff93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:52.601856 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c246e68d-87c7-42bc-bf50-ce311a43ff93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:52.602514 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c246e68d-87c7-42bc-bf50-ce311a43ff93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:52.720897 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-efffeaaf-e43d-463d-a635-35bd1709df74 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:52.722118 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-efffeaaf-e43d-463d-a635-35bd1709df74 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:52.729352 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-efffeaaf-e43d-463d-a635-35bd1709df74 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:52.730037 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-efffeaaf-e43d-463d-a635-35bd1709df74 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:52.731017 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-efffeaaf-e43d-463d-a635-35bd1709df74 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:52.731737 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-efffeaaf-e43d-463d-a635-35bd1709df74 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:53.000781 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-efffeaaf-e43d-463d-a635-35bd1709df74 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:53.013262 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-efffeaaf-e43d-463d-a635-35bd1709df74 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1369 microversion: 2.1 time: 0.298130 Jul 26 12:53:53.018190 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 163/336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:52 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1369 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:53.032105 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e2606dc9-647d-4855-9450-6383ee1f4447 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:53.033428 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e2606dc9-647d-4855-9450-6383ee1f4447 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:53.043733 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e2606dc9-647d-4855-9450-6383ee1f4447 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:53.046521 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e2606dc9-647d-4855-9450-6383ee1f4447 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:53.049098 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e2606dc9-647d-4855-9450-6383ee1f4447 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:53.049885 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e2606dc9-647d-4855-9450-6383ee1f4447 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:53.352654 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e2606dc9-647d-4855-9450-6383ee1f4447 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:53.378695 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e2606dc9-647d-4855-9450-6383ee1f4447 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1367 microversion: 2.1 time: 0.358853 Jul 26 12:53:53.380614 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 164/337] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:53 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:53.386723 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-183b42f0-3a3a-407d-a20d-fc14047a4754 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:53.387329 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-183b42f0-3a3a-407d-a20d-fc14047a4754 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:53.422612 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c246e68d-87c7-42bc-bf50-ce311a43ff93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:53.432639 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-183b42f0-3a3a-407d-a20d-fc14047a4754 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:53.433230 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-183b42f0-3a3a-407d-a20d-fc14047a4754 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:53.436598 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c246e68d-87c7-42bc-bf50-ce311a43ff93 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1465 microversion: 2.1 time: 0.871365 Jul 26 12:53:53.439927 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 174/338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:52 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1465 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:53.448729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-183b42f0-3a3a-407d-a20d-fc14047a4754 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:53.449936 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-183b42f0-3a3a-407d-a20d-fc14047a4754 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:53.513216 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-37a8bf68-6e0d-4519-ba03-ba567bcc5385 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:53.514054 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-37a8bf68-6e0d-4519-ba03-ba567bcc5385 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:53.521231 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-37a8bf68-6e0d-4519-ba03-ba567bcc5385 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:53.521976 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-37a8bf68-6e0d-4519-ba03-ba567bcc5385 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:53.522988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-37a8bf68-6e0d-4519-ba03-ba567bcc5385 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:53.523677 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-37a8bf68-6e0d-4519-ba03-ba567bcc5385 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:53.562253 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-37a8bf68-6e0d-4519-ba03-ba567bcc5385 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Going to try to terminate instance {{(pid=129308) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:53:53.684645 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-37a8bf68-6e0d-4519-ba03-ba567bcc5385 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 204 len: 0 microversion: 2.1 time: 0.167508 Jul 26 12:53:53.688752 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 175/339] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:53:53 2022] DELETE /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:53:53.712712 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-351cd5d3-2a74-4bcd-902c-850e618fd11a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:53.713766 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-351cd5d3-2a74-4bcd-902c-850e618fd11a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:53.724347 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-183b42f0-3a3a-407d-a20d-fc14047a4754 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:53.725122 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-351cd5d3-2a74-4bcd-902c-850e618fd11a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:53.725672 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-351cd5d3-2a74-4bcd-902c-850e618fd11a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:53.726712 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-351cd5d3-2a74-4bcd-902c-850e618fd11a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:53.727234 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-351cd5d3-2a74-4bcd-902c-850e618fd11a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:53.734942 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-183b42f0-3a3a-407d-a20d-fc14047a4754 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:53.740724 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-183b42f0-3a3a-407d-a20d-fc14047a4754 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:53.745931 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-183b42f0-3a3a-407d-a20d-fc14047a4754 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1741 microversion: 2.20 time: 0.364011 Jul 26 12:53:53.753142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 165/340] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:53 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1741 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:53.942306 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-351cd5d3-2a74-4bcd-902c-850e618fd11a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:53.952327 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-351cd5d3-2a74-4bcd-902c-850e618fd11a tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1471 microversion: 2.1 time: 0.255711 Jul 26 12:53:53.953255 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 176/341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:53 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:54.045798 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2115460a-f234-4f26-9698-3b695faf46a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:54.046727 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2115460a-f234-4f26-9698-3b695faf46a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:54.059430 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2115460a-f234-4f26-9698-3b695faf46a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:54.059954 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2115460a-f234-4f26-9698-3b695faf46a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:54.061209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2115460a-f234-4f26-9698-3b695faf46a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:54.061830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2115460a-f234-4f26-9698-3b695faf46a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:54.269682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2115460a-f234-4f26-9698-3b695faf46a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:54.281618 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2115460a-f234-4f26-9698-3b695faf46a2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1369 microversion: 2.1 time: 0.239939 Jul 26 12:53:54.282617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 166/342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:54 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1369 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:54.407167 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ce5e65fd-0173-4630-836e-b5f24bfd64b0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:54.408286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ce5e65fd-0173-4630-836e-b5f24bfd64b0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:54.417283 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ce5e65fd-0173-4630-836e-b5f24bfd64b0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:54.418140 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ce5e65fd-0173-4630-836e-b5f24bfd64b0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:54.419124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ce5e65fd-0173-4630-836e-b5f24bfd64b0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:54.419663 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ce5e65fd-0173-4630-836e-b5f24bfd64b0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:54.579122 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ce5e65fd-0173-4630-836e-b5f24bfd64b0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:54.587839 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ce5e65fd-0173-4630-836e-b5f24bfd64b0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1367 microversion: 2.1 time: 0.186178 Jul 26 12:53:54.600347 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 177/343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:54 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:54.772258 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-83717f2c-bbe7-4ef5-9134-cf1e068ba8a5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:54.772856 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-83717f2c-bbe7-4ef5-9134-cf1e068ba8a5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:54.781305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83717f2c-bbe7-4ef5-9134-cf1e068ba8a5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:54.781754 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83717f2c-bbe7-4ef5-9134-cf1e068ba8a5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:54.782523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83717f2c-bbe7-4ef5-9134-cf1e068ba8a5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:54.782953 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83717f2c-bbe7-4ef5-9134-cf1e068ba8a5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:54.957448 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-83717f2c-bbe7-4ef5-9134-cf1e068ba8a5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:54.966782 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-83717f2c-bbe7-4ef5-9134-cf1e068ba8a5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:54.968358 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-83717f2c-bbe7-4ef5-9134-cf1e068ba8a5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:54.969517 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-83717f2c-bbe7-4ef5-9134-cf1e068ba8a5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1741 microversion: 2.20 time: 0.202619 Jul 26 12:53:54.970054 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 167/344] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:54 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:54.975689 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-21dafdad-cedc-4281-bead-662e435ba14b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:54.976320 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-21dafdad-cedc-4281-bead-662e435ba14b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:54.987124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-21dafdad-cedc-4281-bead-662e435ba14b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:54.987585 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-21dafdad-cedc-4281-bead-662e435ba14b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:54.988380 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-21dafdad-cedc-4281-bead-662e435ba14b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:54.988816 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-21dafdad-cedc-4281-bead-662e435ba14b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:55.244916 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-21dafdad-cedc-4281-bead-662e435ba14b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:55.262008 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-21dafdad-cedc-4281-bead-662e435ba14b tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1471 microversion: 2.1 time: 0.290531 Jul 26 12:53:55.273332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 178/345] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:54 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1471 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:55.307085 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5a2a504d-be0a-4cd3-9cd8-c98f59a852b6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:55.309152 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5a2a504d-be0a-4cd3-9cd8-c98f59a852b6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:55.316090 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5a2a504d-be0a-4cd3-9cd8-c98f59a852b6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:55.316916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5a2a504d-be0a-4cd3-9cd8-c98f59a852b6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:55.318475 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5a2a504d-be0a-4cd3-9cd8-c98f59a852b6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:55.319012 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5a2a504d-be0a-4cd3-9cd8-c98f59a852b6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:55.415371 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-bbab229f-b6ca-4677-91b0-381e45d87a0c req-e5a67ec6-a848-4dda-b58e-4e7d3d6bbc15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd47bdd7-0e5c-45eb-a6fb-979300251996", "name": "network-vif-plugged", "status": "completed", "tag": "0da5fda1-917d-45ee-bba6-4a249f129d9a"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:55.445892 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-bbab229f-b6ca-4677-91b0-381e45d87a0c req-e5a67ec6-a848-4dda-b58e-4e7d3d6bbc15 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:55.450350 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-bbab229f-b6ca-4677-91b0-381e45d87a0c req-e5a67ec6-a848-4dda-b58e-4e7d3d6bbc15 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:55.477426 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-bbab229f-b6ca-4677-91b0-381e45d87a0c req-e5a67ec6-a848-4dda-b58e-4e7d3d6bbc15 service nova] Creating event network-vif-plugged:0da5fda1-917d-45ee-bba6-4a249f129d9a for instance cd47bdd7-0e5c-45eb-a6fb-979300251996 on hv-cinder-85093 Jul 26 12:53:55.494715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-bbab229f-b6ca-4677-91b0-381e45d87a0c req-e5a67ec6-a848-4dda-b58e-4e7d3d6bbc15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083488 Jul 26 12:53:55.499335 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 179/346] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:53:55.612278 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5a2a504d-be0a-4cd3-9cd8-c98f59a852b6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:55.615922 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-aaca7be8-9c57-424d-b6b7-de622cbb95b2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:55.616582 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-aaca7be8-9c57-424d-b6b7-de622cbb95b2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:55.626605 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5a2a504d-be0a-4cd3-9cd8-c98f59a852b6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1369 microversion: 2.1 time: 0.323762 Jul 26 12:53:55.635867 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aaca7be8-9c57-424d-b6b7-de622cbb95b2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:55.638104 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 168/347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:55 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1369 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:55.643184 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aaca7be8-9c57-424d-b6b7-de622cbb95b2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:55.644446 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aaca7be8-9c57-424d-b6b7-de622cbb95b2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:55.644959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aaca7be8-9c57-424d-b6b7-de622cbb95b2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:55.869646 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-aaca7be8-9c57-424d-b6b7-de622cbb95b2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:55.886814 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-aaca7be8-9c57-424d-b6b7-de622cbb95b2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1367 microversion: 2.1 time: 0.273435 Jul 26 12:53:55.900114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 180/348] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:55 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:55.997741 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d0b410cc-5576-4d9b-9a8c-3e31f62056ab tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:55.999469 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d0b410cc-5576-4d9b-9a8c-3e31f62056ab tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:56.008492 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d0b410cc-5576-4d9b-9a8c-3e31f62056ab tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:56.009608 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d0b410cc-5576-4d9b-9a8c-3e31f62056ab tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:56.010704 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d0b410cc-5576-4d9b-9a8c-3e31f62056ab tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:56.011550 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d0b410cc-5576-4d9b-9a8c-3e31f62056ab tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:56.251083 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d0b410cc-5576-4d9b-9a8c-3e31f62056ab tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:56.260764 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d0b410cc-5576-4d9b-9a8c-3e31f62056ab tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:56.262712 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d0b410cc-5576-4d9b-9a8c-3e31f62056ab tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:56.264388 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d0b410cc-5576-4d9b-9a8c-3e31f62056ab tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1741 microversion: 2.20 time: 0.273779 Jul 26 12:53:56.265579 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 169/349] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:55 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1741 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:56.286897 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d083ca23-e8cb-443f-af3c-457a822defb1 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:56.287591 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d083ca23-e8cb-443f-af3c-457a822defb1 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:56.294823 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d083ca23-e8cb-443f-af3c-457a822defb1 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:56.295116 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d083ca23-e8cb-443f-af3c-457a822defb1 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:56.295949 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d083ca23-e8cb-443f-af3c-457a822defb1 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:56.296381 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d083ca23-e8cb-443f-af3c-457a822defb1 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:56.545018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d083ca23-e8cb-443f-af3c-457a822defb1 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:56.557769 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d083ca23-e8cb-443f-af3c-457a822defb1 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1471 microversion: 2.1 time: 0.275471 Jul 26 12:53:56.558636 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 181/350] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:56 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1471 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:56.650764 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-09340c0b-dc29-4567-8293-8b9ce5a255a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:56.651371 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-09340c0b-dc29-4567-8293-8b9ce5a255a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:56.657712 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-09340c0b-dc29-4567-8293-8b9ce5a255a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:56.658459 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-09340c0b-dc29-4567-8293-8b9ce5a255a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:56.659446 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-09340c0b-dc29-4567-8293-8b9ce5a255a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:56.660055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-09340c0b-dc29-4567-8293-8b9ce5a255a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:56.915955 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-75c39149-63b2-47c2-a470-d45f578d8278 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:56.915955 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-75c39149-63b2-47c2-a470-d45f578d8278 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:56.930720 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-75c39149-63b2-47c2-a470-d45f578d8278 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:56.931414 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-75c39149-63b2-47c2-a470-d45f578d8278 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:56.932411 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-75c39149-63b2-47c2-a470-d45f578d8278 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:56.933004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-75c39149-63b2-47c2-a470-d45f578d8278 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:57.002382 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-09340c0b-dc29-4567-8293-8b9ce5a255a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:57.018034 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-09340c0b-dc29-4567-8293-8b9ce5a255a9 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1369 microversion: 2.1 time: 0.368984 Jul 26 12:53:57.018981 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 170/351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:56 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1369 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:57.163875 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-75c39149-63b2-47c2-a470-d45f578d8278 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:57.172409 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-75c39149-63b2-47c2-a470-d45f578d8278 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1367 microversion: 2.1 time: 0.262155 Jul 26 12:53:57.176991 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 182/352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:56 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:57.291129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3367324b-9feb-4ebd-9137-7c5e55d1f73a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:57.291817 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3367324b-9feb-4ebd-9137-7c5e55d1f73a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:57.311885 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3367324b-9feb-4ebd-9137-7c5e55d1f73a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:57.313597 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3367324b-9feb-4ebd-9137-7c5e55d1f73a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:57.314813 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3367324b-9feb-4ebd-9137-7c5e55d1f73a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:57.315575 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3367324b-9feb-4ebd-9137-7c5e55d1f73a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:57.351965 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=100 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:57.529193 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-c1c2e584-1645-4e96-8a3b-c57aaded70d6 req-b3330750-b75c-4f6c-acf8-5e98c74fb792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc189b1-f457-4614-9639-b10131941960", "name": "network-vif-deleted", "tag": "53cbdca1-deba-44f6-8b56-5b94884fd66d"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:57.551444 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-c1c2e584-1645-4e96-8a3b-c57aaded70d6 req-b3330750-b75c-4f6c-acf8-5e98c74fb792 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:57.555364 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-c1c2e584-1645-4e96-8a3b-c57aaded70d6 req-b3330750-b75c-4f6c-acf8-5e98c74fb792 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:57.615141 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-c1c2e584-1645-4e96-8a3b-c57aaded70d6 req-b3330750-b75c-4f6c-acf8-5e98c74fb792 service nova] Creating event network-vif-deleted:53cbdca1-deba-44f6-8b56-5b94884fd66d for instance 9dc189b1-f457-4614-9639-b10131941960 on hv-cinder-85093 Jul 26 12:53:57.643237 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-c1c2e584-1645-4e96-8a3b-c57aaded70d6 req-b3330750-b75c-4f6c-acf8-5e98c74fb792 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117039 Jul 26 12:53:57.664761 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 183/353] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 26 12:53:57.687436 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6930e993-022a-4f48-a87c-6ace2bacebab tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:57.696223 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6930e993-022a-4f48-a87c-6ace2bacebab tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:57.724442 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6930e993-022a-4f48-a87c-6ace2bacebab tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:57.726216 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6930e993-022a-4f48-a87c-6ace2bacebab tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:57.726668 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6930e993-022a-4f48-a87c-6ace2bacebab tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:57.737018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6930e993-022a-4f48-a87c-6ace2bacebab tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:57.831215 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3367324b-9feb-4ebd-9137-7c5e55d1f73a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:57.848048 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3367324b-9feb-4ebd-9137-7c5e55d1f73a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:57.850943 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3367324b-9feb-4ebd-9137-7c5e55d1f73a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:57.855739 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3367324b-9feb-4ebd-9137-7c5e55d1f73a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1741 microversion: 2.20 time: 0.569609 Jul 26 12:53:57.857454 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 171/354] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:57 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1741 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:53:57.865807 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6930e993-022a-4f48-a87c-6ace2bacebab tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:57.868442 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6930e993-022a-4f48-a87c-6ace2bacebab tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:57.869192 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-dcb6eed7-b642-4b3a-aa40-527fd465ff8c req-1d10c09d-73de-4ee2-988c-c5a5c6db7bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa1010ce-5874-41a9-900d-cb5355c11d1b", "name": "network-vif-plugged", "status": "completed", "tag": "bcfd2cdd-0eb0-4f90-9350-81a2f6098d4e"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:53:57.870122 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-6930e993-022a-4f48-a87c-6ace2bacebab tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lazy-loading 'fault' on Instance uuid 9dc189b1-f457-4614-9639-b10131941960 {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:53:57.917953 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-dcb6eed7-b642-4b3a-aa40-527fd465ff8c req-1d10c09d-73de-4ee2-988c-c5a5c6db7bee service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:57.918464 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-dcb6eed7-b642-4b3a-aa40-527fd465ff8c req-1d10c09d-73de-4ee2-988c-c5a5c6db7bee service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:57.931159 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-dcb6eed7-b642-4b3a-aa40-527fd465ff8c req-1d10c09d-73de-4ee2-988c-c5a5c6db7bee service nova] Creating event network-vif-plugged:bcfd2cdd-0eb0-4f90-9350-81a2f6098d4e for instance fa1010ce-5874-41a9-900d-cb5355c11d1b on hv-cinder-85093 Jul 26 12:53:57.946339 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-dcb6eed7-b642-4b3a-aa40-527fd465ff8c req-1d10c09d-73de-4ee2-988c-c5a5c6db7bee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086509 Jul 26 12:53:57.947711 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 172/355] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:53:57.972843 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6930e993-022a-4f48-a87c-6ace2bacebab tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:57.984669 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6930e993-022a-4f48-a87c-6ace2bacebab tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1305 microversion: 2.1 time: 0.312792 Jul 26 12:53:58.001675 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 184/356] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:57 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1305 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:58.051957 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-11d48a4b-0473-4634-9312-9b9bb87a24ec tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:58.053426 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-11d48a4b-0473-4634-9312-9b9bb87a24ec tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:58.070748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-11d48a4b-0473-4634-9312-9b9bb87a24ec tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:58.071528 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-11d48a4b-0473-4634-9312-9b9bb87a24ec tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:58.072547 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-11d48a4b-0473-4634-9312-9b9bb87a24ec tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:58.073191 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-11d48a4b-0473-4634-9312-9b9bb87a24ec tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:58.200582 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-03f573a4-e805-439c-8ee7-b27b73568cee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:58.201214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-03f573a4-e805-439c-8ee7-b27b73568cee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:58.218123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-03f573a4-e805-439c-8ee7-b27b73568cee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:58.218715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-03f573a4-e805-439c-8ee7-b27b73568cee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:58.221717 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-03f573a4-e805-439c-8ee7-b27b73568cee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:58.222805 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-03f573a4-e805-439c-8ee7-b27b73568cee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:58.281014 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-11d48a4b-0473-4634-9312-9b9bb87a24ec tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:58.301493 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-11d48a4b-0473-4634-9312-9b9bb87a24ec tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1369 microversion: 2.1 time: 0.261379 Jul 26 12:53:58.313529 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 173/357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:58 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1369 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:58.424351 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-03f573a4-e805-439c-8ee7-b27b73568cee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:58.434808 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-03f573a4-e805-439c-8ee7-b27b73568cee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1367 microversion: 2.1 time: 0.239207 Jul 26 12:53:58.446107 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 185/358] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:58 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:58.883687 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d41d503e-717f-4f13-8a8a-b160b6d0c38a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:58.884216 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d41d503e-717f-4f13-8a8a-b160b6d0c38a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:58.894286 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d41d503e-717f-4f13-8a8a-b160b6d0c38a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:58.895018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d41d503e-717f-4f13-8a8a-b160b6d0c38a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:58.896552 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d41d503e-717f-4f13-8a8a-b160b6d0c38a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:58.897143 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d41d503e-717f-4f13-8a8a-b160b6d0c38a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:59.015523 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c3152643-dd63-4624-9db2-a736ae6ff567 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:59.016577 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c3152643-dd63-4624-9db2-a736ae6ff567 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:59.034130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c3152643-dd63-4624-9db2-a736ae6ff567 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:59.034894 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c3152643-dd63-4624-9db2-a736ae6ff567 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:59.041462 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c3152643-dd63-4624-9db2-a736ae6ff567 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:59.042192 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c3152643-dd63-4624-9db2-a736ae6ff567 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:59.065417 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:53:59.113949 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c3152643-dd63-4624-9db2-a736ae6ff567 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:59.114571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c3152643-dd63-4624-9db2-a736ae6ff567 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:59.115298 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-c3152643-dd63-4624-9db2-a736ae6ff567 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lazy-loading 'fault' on Instance uuid 9dc189b1-f457-4614-9639-b10131941960 {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:53:59.203515 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c3152643-dd63-4624-9db2-a736ae6ff567 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc8e48fa3a38429b9925b519ca28c1e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbda6b838e3b4a8f89a693e4c5174695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:59.216442 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c3152643-dd63-4624-9db2-a736ae6ff567 tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 200 len: 1305 microversion: 2.1 time: 0.209309 Jul 26 12:53:59.223993 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 186/359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:59 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 1305 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:53:59.251173 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d41d503e-717f-4f13-8a8a-b160b6d0c38a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:59.276879 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d41d503e-717f-4f13-8a8a-b160b6d0c38a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:59.280765 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d41d503e-717f-4f13-8a8a-b160b6d0c38a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:59.286301 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d41d503e-717f-4f13-8a8a-b160b6d0c38a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1741 microversion: 2.20 time: 0.407608 Jul 26 12:53:59.287349 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 174/360] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:53:58 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1741 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:53:59.326491 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-78c10775-f535-4d59-bfe4-ba7c74768ebb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:59.327169 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-78c10775-f535-4d59-bfe4-ba7c74768ebb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:59.337480 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-78c10775-f535-4d59-bfe4-ba7c74768ebb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:59.337955 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-78c10775-f535-4d59-bfe4-ba7c74768ebb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:59.341624 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-78c10775-f535-4d59-bfe4-ba7c74768ebb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:59.343365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-78c10775-f535-4d59-bfe4-ba7c74768ebb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:59.457497 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-80704918-f573-41c7-adcc-b40cdb66dab3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:59.458154 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-80704918-f573-41c7-adcc-b40cdb66dab3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:59.471919 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-80704918-f573-41c7-adcc-b40cdb66dab3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:59.472378 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-80704918-f573-41c7-adcc-b40cdb66dab3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:59.473169 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-80704918-f573-41c7-adcc-b40cdb66dab3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:59.473651 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-80704918-f573-41c7-adcc-b40cdb66dab3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:59.732412 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-78c10775-f535-4d59-bfe4-ba7c74768ebb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:59.742934 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-78c10775-f535-4d59-bfe4-ba7c74768ebb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1562 microversion: 2.1 time: 0.421043 Jul 26 12:53:59.777215 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 187/361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:59 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1562 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:59.795629 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3df62a63-f82e-48be-8950-b9e19fe56fbb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:53:59.796801 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3df62a63-f82e-48be-8950-b9e19fe56fbb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:53:59.814664 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3df62a63-f82e-48be-8950-b9e19fe56fbb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:59.815325 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3df62a63-f82e-48be-8950-b9e19fe56fbb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:59.816356 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3df62a63-f82e-48be-8950-b9e19fe56fbb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:53:59.816967 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3df62a63-f82e-48be-8950-b9e19fe56fbb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:53:59.894891 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-80704918-f573-41c7-adcc-b40cdb66dab3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:53:59.908334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-80704918-f573-41c7-adcc-b40cdb66dab3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1367 microversion: 2.1 time: 0.454637 Jul 26 12:53:59.909671 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 175/362] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:53:59 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:53:59.992122 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3df62a63-f82e-48be-8950-b9e19fe56fbb tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210261 Jul 26 12:53:59.993196 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 188/363] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Jul 26 12:53:59 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:54:00.250839 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-35022e89-83e3-4c41-a6aa-bc038a5d4ffe tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:00.251790 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-35022e89-83e3-4c41-a6aa-bc038a5d4ffe tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] [instance: 9dc189b1-f457-4614-9639-b10131941960] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:00.263389 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35022e89-83e3-4c41-a6aa-bc038a5d4ffe tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:00.266892 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35022e89-83e3-4c41-a6aa-bc038a5d4ffe tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:00.267902 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35022e89-83e3-4c41-a6aa-bc038a5d4ffe tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:00.269315 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35022e89-83e3-4c41-a6aa-bc038a5d4ffe tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:00.294083 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-35022e89-83e3-4c41-a6aa-bc038a5d4ffe tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] HTTP exception thrown: Instance 9dc189b1-f457-4614-9639-b10131941960 could not be found. Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-35022e89-83e3-4c41-a6aa-bc038a5d4ffe tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Request method failure captured: Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 HTTP/1.1 Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-O8TZ_zg06rdCPHhIZvOwbY2SwduCfsY4khJxTYJLVVpMWkPuYRLr3-FsjYnqL9GCxj5ZOtOy_uVoZkAgTpW0kkJQwNeFnN-iZSq6OrFDP37Nl_chs0yOVzIKUT_GvB50U4nT8PYPzg_muDs0r78EOaYizyQm0LDwhy_CgN6b4QisE Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: fbda6b838e3b4a8f89a693e4c5174695 Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-VolumesNegativeTest-1537592522 Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:54:00.305530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:54:00.306966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fbda6b838e3b4a8f89a693e4c5174695"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fbda6b838e3b4a8f89a693e4c5174695", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbda6b838e3b4a8f89a693e4c5174695"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fbda6b838e3b4a8f89a693e4c5174695"}]}] Jul 26 12:54:00.306966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-VolumesNegativeTest-1537592522 Jul 26 12:54:00.306966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: fbda6b838e3b4a8f89a693e4c5174695 Jul 26 12:54:00.306966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-VolumesNegativeTest-1537592522 Jul 26 12:54:00.306966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-VolumesNegativeTest-1537592522-project Jul 26 12:54:00.306966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:54:00.306966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:54:00.306966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: bc8e48fa3a38429b9925b519ca28c1e2 Jul 26 12:54:00.306966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-VolumesNegativeTest-1537592522-project Jul 26 12:54:00.306966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:54:00.306966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 9dc189b1-f457-4614-9639-b10131941960 could not be found. Jul 26 12:54:00.306966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '9dc189b1-f457-4614-9639-b10131941960'} Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc189b1-f457-4614-9639-b10131941960 could not be found. Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:54:00.307958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc189b1-f457-4614-9639-b10131941960 could not be found. Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc189b1-f457-4614-9639-b10131941960 could not be found. Jul 26 12:54:00.309273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:54:00.312293 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-35022e89-83e3-4c41-a6aa-bc038a5d4ffe tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] Returning 404 to user: Instance 9dc189b1-f457-4614-9639-b10131941960 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:54:00.313367 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-35022e89-83e3-4c41-a6aa-bc038a5d4ffe tempest-VolumesNegativeTest-1537592522 tempest-VolumesNegativeTest-1537592522-project] 10.222.0.20 "GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960" status: 404 len: 111 microversion: 2.1 time: 0.066750 Jul 26 12:54:00.313525 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-111144da-0869-474a-9b64-7e9c585f1855 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:00.316339 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 176/364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:54:00 2022] GET /compute/v2.1/servers/9dc189b1-f457-4614-9639-b10131941960 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:54:00.323039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-111144da-0869-474a-9b64-7e9c585f1855 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:00.323039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:00.337601 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-111144da-0869-474a-9b64-7e9c585f1855 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:00.338053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-111144da-0869-474a-9b64-7e9c585f1855 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:00.338830 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-111144da-0869-474a-9b64-7e9c585f1855 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:00.343700 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-111144da-0869-474a-9b64-7e9c585f1855 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:00.902734 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-111144da-0869-474a-9b64-7e9c585f1855 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:00.920883 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-111144da-0869-474a-9b64-7e9c585f1855 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:00.922513 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-111144da-0869-474a-9b64-7e9c585f1855 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:00.930502 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ecdd733b-2279-4f34-bc38-d0c7db3abd39 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:00.931306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ecdd733b-2279-4f34-bc38-d0c7db3abd39 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:00.931696 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-111144da-0869-474a-9b64-7e9c585f1855 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1741 microversion: 2.20 time: 0.622365 Jul 26 12:54:00.941655 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ecdd733b-2279-4f34-bc38-d0c7db3abd39 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:00.943089 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ecdd733b-2279-4f34-bc38-d0c7db3abd39 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:00.945349 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ecdd733b-2279-4f34-bc38-d0c7db3abd39 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:00.953048 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ecdd733b-2279-4f34-bc38-d0c7db3abd39 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:00.970768 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 189/365] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:00 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1741 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:01.119017 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ecdd733b-2279-4f34-bc38-d0c7db3abd39 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:01.128801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ecdd733b-2279-4f34-bc38-d0c7db3abd39 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1367 microversion: 2.1 time: 0.202843 Jul 26 12:54:01.143150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 177/366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:54:00 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:54:01.513017 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-949e81d0-c516-4314-bbb4-5f60214128cc req-72c6c68d-9301-4b0f-be5c-4aa42c1f70ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd47bdd7-0e5c-45eb-a6fb-979300251996", "tag": "0da5fda1-917d-45ee-bba6-4a249f129d9a"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:54:01.534852 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-949e81d0-c516-4314-bbb4-5f60214128cc req-72c6c68d-9301-4b0f-be5c-4aa42c1f70ac service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:01.540306 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-949e81d0-c516-4314-bbb4-5f60214128cc req-72c6c68d-9301-4b0f-be5c-4aa42c1f70ac service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:01.558734 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-949e81d0-c516-4314-bbb4-5f60214128cc req-72c6c68d-9301-4b0f-be5c-4aa42c1f70ac service nova] Creating event network-changed:0da5fda1-917d-45ee-bba6-4a249f129d9a for instance cd47bdd7-0e5c-45eb-a6fb-979300251996 on hv-cinder-85093 Jul 26 12:54:01.567812 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-949e81d0-c516-4314-bbb4-5f60214128cc req-72c6c68d-9301-4b0f-be5c-4aa42c1f70ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065362 Jul 26 12:54:01.569171 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 190/367] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:54:01.965777 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3f54faf1-6b7d-4ae8-9a9a-115eafb1fe0a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:01.966376 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3f54faf1-6b7d-4ae8-9a9a-115eafb1fe0a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:01.974500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f54faf1-6b7d-4ae8-9a9a-115eafb1fe0a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:01.975268 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f54faf1-6b7d-4ae8-9a9a-115eafb1fe0a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:01.976187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f54faf1-6b7d-4ae8-9a9a-115eafb1fe0a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:01.977265 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3f54faf1-6b7d-4ae8-9a9a-115eafb1fe0a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:02.159104 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1841a2e3-ab42-43e3-8fc7-0143eb905152 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:02.161523 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1841a2e3-ab42-43e3-8fc7-0143eb905152 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:02.177780 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1841a2e3-ab42-43e3-8fc7-0143eb905152 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:02.179670 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1841a2e3-ab42-43e3-8fc7-0143eb905152 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:02.182268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1841a2e3-ab42-43e3-8fc7-0143eb905152 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:02.182810 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1841a2e3-ab42-43e3-8fc7-0143eb905152 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:02.219823 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3f54faf1-6b7d-4ae8-9a9a-115eafb1fe0a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:02.231619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3f54faf1-6b7d-4ae8-9a9a-115eafb1fe0a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:02.233342 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3f54faf1-6b7d-4ae8-9a9a-115eafb1fe0a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:02.234641 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3f54faf1-6b7d-4ae8-9a9a-115eafb1fe0a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1741 microversion: 2.20 time: 0.273245 Jul 26 12:54:02.235562 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 178/368] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:01 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1741 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:02.427050 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1841a2e3-ab42-43e3-8fc7-0143eb905152 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:02.437504 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1841a2e3-ab42-43e3-8fc7-0143eb905152 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1557 microversion: 2.1 time: 0.289915 Jul 26 12:54:02.438344 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 191/369] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:54:02 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1557 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:54:02.465348 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-93e45fbf-a826-4a0f-b5a8-581cb615a0f5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:02.466416 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-93e45fbf-a826-4a0f-b5a8-581cb615a0f5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:02.475565 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-93e45fbf-a826-4a0f-b5a8-581cb615a0f5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:02.476689 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-93e45fbf-a826-4a0f-b5a8-581cb615a0f5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:02.477710 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-93e45fbf-a826-4a0f-b5a8-581cb615a0f5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:02.478331 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-93e45fbf-a826-4a0f-b5a8-581cb615a0f5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:02.643249 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-93e45fbf-a826-4a0f-b5a8-581cb615a0f5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185704 Jul 26 12:54:02.644182 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 179/370] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Jul 26 12:54:02 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:54:03.266013 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-60e2180a-ea5f-43f7-aa45-6f180ead26e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:03.266616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-60e2180a-ea5f-43f7-aa45-6f180ead26e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:03.281162 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-60e2180a-ea5f-43f7-aa45-6f180ead26e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:03.281617 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-60e2180a-ea5f-43f7-aa45-6f180ead26e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:03.282406 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-60e2180a-ea5f-43f7-aa45-6f180ead26e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:03.282836 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-60e2180a-ea5f-43f7-aa45-6f180ead26e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:03.744090 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-60e2180a-ea5f-43f7-aa45-6f180ead26e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:03.756266 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-60e2180a-ea5f-43f7-aa45-6f180ead26e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:03.758322 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-60e2180a-ea5f-43f7-aa45-6f180ead26e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:03.760000 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-60e2180a-ea5f-43f7-aa45-6f180ead26e2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1741 microversion: 2.20 time: 0.497649 Jul 26 12:54:03.761048 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 192/371] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:03 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1741 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:04.556747 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-c5a1dc3d-1ae3-4458-88bf-b53a08df2e14 req-02281de2-84fe-4b81-bdd8-898d571d83ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa1010ce-5874-41a9-900d-cb5355c11d1b", "tag": "bcfd2cdd-0eb0-4f90-9350-81a2f6098d4e"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:54:04.569744 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-c5a1dc3d-1ae3-4458-88bf-b53a08df2e14 req-02281de2-84fe-4b81-bdd8-898d571d83ef service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:04.570439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-c5a1dc3d-1ae3-4458-88bf-b53a08df2e14 req-02281de2-84fe-4b81-bdd8-898d571d83ef service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:04.586081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-c5a1dc3d-1ae3-4458-88bf-b53a08df2e14 req-02281de2-84fe-4b81-bdd8-898d571d83ef service nova] Creating event network-changed:bcfd2cdd-0eb0-4f90-9350-81a2f6098d4e for instance fa1010ce-5874-41a9-900d-cb5355c11d1b on hv-cinder-85093 Jul 26 12:54:04.604531 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-c5a1dc3d-1ae3-4458-88bf-b53a08df2e14 req-02281de2-84fe-4b81-bdd8-898d571d83ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053546 Jul 26 12:54:04.605419 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 180/372] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:54:04.783270 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-26af3913-600f-4323-8a9e-212c025c0dd8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:04.783959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-26af3913-600f-4323-8a9e-212c025c0dd8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:04.797186 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-26af3913-600f-4323-8a9e-212c025c0dd8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:04.797629 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-26af3913-600f-4323-8a9e-212c025c0dd8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:04.798415 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-26af3913-600f-4323-8a9e-212c025c0dd8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:04.798847 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-26af3913-600f-4323-8a9e-212c025c0dd8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:05.006134 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-26af3913-600f-4323-8a9e-212c025c0dd8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:05.019298 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-26af3913-600f-4323-8a9e-212c025c0dd8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:05.020880 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-26af3913-600f-4323-8a9e-212c025c0dd8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:05.022132 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-26af3913-600f-4323-8a9e-212c025c0dd8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1741 microversion: 2.20 time: 0.242964 Jul 26 12:54:05.023516 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 193/373] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:04 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1741 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:06.056248 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-48a8af58-b0f8-4ca8-82bc-714e81dd63e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:06.057804 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-48a8af58-b0f8-4ca8-82bc-714e81dd63e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:06.067754 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-48a8af58-b0f8-4ca8-82bc-714e81dd63e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:06.068622 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-48a8af58-b0f8-4ca8-82bc-714e81dd63e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:06.069972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-48a8af58-b0f8-4ca8-82bc-714e81dd63e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:06.070571 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-48a8af58-b0f8-4ca8-82bc-714e81dd63e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:06.374943 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-48a8af58-b0f8-4ca8-82bc-714e81dd63e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:06.388797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-48a8af58-b0f8-4ca8-82bc-714e81dd63e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:06.391607 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-48a8af58-b0f8-4ca8-82bc-714e81dd63e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:06.393793 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-48a8af58-b0f8-4ca8-82bc-714e81dd63e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1741 microversion: 2.20 time: 0.347185 Jul 26 12:54:06.394627 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 181/374] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:06 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1741 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:07.421329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ebacf40d-c304-47e1-adb9-0417c1100a21 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:07.422797 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ebacf40d-c304-47e1-adb9-0417c1100a21 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:07.430990 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ebacf40d-c304-47e1-adb9-0417c1100a21 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:07.431605 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ebacf40d-c304-47e1-adb9-0417c1100a21 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:07.433292 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ebacf40d-c304-47e1-adb9-0417c1100a21 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:07.433759 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ebacf40d-c304-47e1-adb9-0417c1100a21 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:07.617308 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ebacf40d-c304-47e1-adb9-0417c1100a21 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:07.626899 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ebacf40d-c304-47e1-adb9-0417c1100a21 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:07.628544 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ebacf40d-c304-47e1-adb9-0417c1100a21 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:07.630088 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ebacf40d-c304-47e1-adb9-0417c1100a21 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1741 microversion: 2.20 time: 0.213324 Jul 26 12:54:07.630854 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 194/375] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:07 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1741 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:08.661077 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-50ab8aab-f387-4ec1-8a2c-ce06ba178b8d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:08.661987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-50ab8aab-f387-4ec1-8a2c-ce06ba178b8d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:08.669288 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-50ab8aab-f387-4ec1-8a2c-ce06ba178b8d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:08.670014 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-50ab8aab-f387-4ec1-8a2c-ce06ba178b8d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:08.670787 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-50ab8aab-f387-4ec1-8a2c-ce06ba178b8d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:08.671220 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-50ab8aab-f387-4ec1-8a2c-ce06ba178b8d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:08.830498 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-50ab8aab-f387-4ec1-8a2c-ce06ba178b8d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:08.841300 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-50ab8aab-f387-4ec1-8a2c-ce06ba178b8d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:08.842855 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-50ab8aab-f387-4ec1-8a2c-ce06ba178b8d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:08.844307 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-50ab8aab-f387-4ec1-8a2c-ce06ba178b8d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1741 microversion: 2.20 time: 0.188030 Jul 26 12:54:08.845775 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 182/376] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:08 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:09.867933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e7f1603f-ac5d-4886-a59a-beef8534dfbe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:09.868551 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e7f1603f-ac5d-4886-a59a-beef8534dfbe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:09.875908 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e7f1603f-ac5d-4886-a59a-beef8534dfbe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:09.876554 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e7f1603f-ac5d-4886-a59a-beef8534dfbe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:09.878473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e7f1603f-ac5d-4886-a59a-beef8534dfbe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:09.878473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e7f1603f-ac5d-4886-a59a-beef8534dfbe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:10.084065 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e7f1603f-ac5d-4886-a59a-beef8534dfbe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:10.107293 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e7f1603f-ac5d-4886-a59a-beef8534dfbe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:10.110019 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e7f1603f-ac5d-4886-a59a-beef8534dfbe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:10.112556 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e7f1603f-ac5d-4886-a59a-beef8534dfbe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1723 microversion: 2.20 time: 0.248875 Jul 26 12:54:10.114403 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 195/377] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:09 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:11.145546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2667f51c-ff5f-4797-a9be-745c86454131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:11.146067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2667f51c-ff5f-4797-a9be-745c86454131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:11.147119 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-de5e1515-b249-4b66-9a73-3c2cc92b37b7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97b4ccd8-1a9b-4847-ac5a-d97ca7cb4fa2", "device": "/dev/sdb"}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:54:11.153630 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-de5e1515-b249-4b66-9a73-3c2cc92b37b7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:11.169653 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2667f51c-ff5f-4797-a9be-745c86454131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:11.171872 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2667f51c-ff5f-4797-a9be-745c86454131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:11.174334 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-de5e1515-b249-4b66-9a73-3c2cc92b37b7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:11.179240 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2667f51c-ff5f-4797-a9be-745c86454131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:11.179240 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2667f51c-ff5f-4797-a9be-745c86454131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:11.185247 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-de5e1515-b249-4b66-9a73-3c2cc92b37b7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:11.187853 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-de5e1515-b249-4b66-9a73-3c2cc92b37b7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:11.189884 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-de5e1515-b249-4b66-9a73-3c2cc92b37b7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:11.557973 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2667f51c-ff5f-4797-a9be-745c86454131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:11.571957 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2667f51c-ff5f-4797-a9be-745c86454131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:11.573574 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2667f51c-ff5f-4797-a9be-745c86454131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:11.579453 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2667f51c-ff5f-4797-a9be-745c86454131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1723 microversion: 2.20 time: 0.443112 Jul 26 12:54:11.580262 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 183/378] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:11 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1723 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:11.593515 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-b7d396b6-4c9b-415c-b7bd-0caeb6265306 req-d3288abf-c2a9-48f6-8481-d4cfaf714dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20220b7e-2897-4f0c-98da-3f352aa39ec2", "name": "network-vif-unplugged", "status": "completed", "tag": "32e67b58-c4c4-4a07-b551-08232595ea42"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:54:11.615932 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=86 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:11.625891 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-b7d396b6-4c9b-415c-b7bd-0caeb6265306 req-d3288abf-c2a9-48f6-8481-d4cfaf714dba service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:11.637803 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-b7d396b6-4c9b-415c-b7bd-0caeb6265306 req-d3288abf-c2a9-48f6-8481-d4cfaf714dba service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:11.669200 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-b7d396b6-4c9b-415c-b7bd-0caeb6265306 req-d3288abf-c2a9-48f6-8481-d4cfaf714dba service nova] Creating event network-vif-unplugged:32e67b58-c4c4-4a07-b551-08232595ea42 for instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 on hv-cinder-85093 Jul 26 12:54:11.678757 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-b7d396b6-4c9b-415c-b7bd-0caeb6265306 req-d3288abf-c2a9-48f6-8481-d4cfaf714dba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096004 Jul 26 12:54:11.684359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 184/379] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:54:11.743821 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-de5e1515-b249-4b66-9a73-3c2cc92b37b7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "POST /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.606885 Jul 26 12:54:11.747693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 196/380] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 12:54:11 2022] POST /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67/os-volume_attachments => generated 194 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:54:12.611394 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-7f19224d-3075-4d4d-92af-dac3468359fe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:12.612729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-7f19224d-3075-4d4d-92af-dac3468359fe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:12.623770 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7f19224d-3075-4d4d-92af-dac3468359fe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:12.624389 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7f19224d-3075-4d4d-92af-dac3468359fe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:12.625620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7f19224d-3075-4d4d-92af-dac3468359fe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:12.626217 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7f19224d-3075-4d4d-92af-dac3468359fe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:13.010733 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-7f19224d-3075-4d4d-92af-dac3468359fe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:13.018695 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-7f19224d-3075-4d4d-92af-dac3468359fe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:13.020915 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-7f19224d-3075-4d4d-92af-dac3468359fe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:13.022942 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-7f19224d-3075-4d4d-92af-dac3468359fe tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1666 microversion: 2.20 time: 0.415484 Jul 26 12:54:13.023737 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 185/381] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:12 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1666 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:13.049635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f9572e77-978b-49d8-9d11-eebb43df589f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edfc3349-7922-479d-b5d7-12e8d1316fe3"}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:54:13.054332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f9572e77-978b-49d8-9d11-eebb43df589f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:13.061718 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f9572e77-978b-49d8-9d11-eebb43df589f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:13.062458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f9572e77-978b-49d8-9d11-eebb43df589f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:13.063424 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f9572e77-978b-49d8-9d11-eebb43df589f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:13.064063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f9572e77-978b-49d8-9d11-eebb43df589f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:13.695908 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f9572e77-978b-49d8-9d11-eebb43df589f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "POST /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.650528 Jul 26 12:54:13.703772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 197/382] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Jul 26 12:54:13 2022] POST /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/os-volume_attachments => generated 188 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:54:13.890670 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-83a1fc8c-b802-4080-b52b-a75c61cbc361 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:54:13.891344 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-83a1fc8c-b802-4080-b52b-a75c61cbc361 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:13.910741 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83a1fc8c-b802-4080-b52b-a75c61cbc361 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:13.913686 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83a1fc8c-b802-4080-b52b-a75c61cbc361 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:13.915575 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83a1fc8c-b802-4080-b52b-a75c61cbc361 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:13.916656 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83a1fc8c-b802-4080-b52b-a75c61cbc361 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:14.145556 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-83a1fc8c-b802-4080-b52b-a75c61cbc361 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "POST /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/action" status: 202 len: 0 microversion: 2.20 time: 0.258976 Jul 26 12:54:14.149869 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 186/383] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Jul 26 12:54:13 2022] POST /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:54:14.154740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0b498792-92e0-4a98-9489-899016237459 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:14.155348 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0b498792-92e0-4a98-9489-899016237459 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:14.173949 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0b498792-92e0-4a98-9489-899016237459 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:14.186064 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0b498792-92e0-4a98-9489-899016237459 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:14.187043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0b498792-92e0-4a98-9489-899016237459 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:14.187691 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0b498792-92e0-4a98-9489-899016237459 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:14.671555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0b498792-92e0-4a98-9489-899016237459 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:14.680998 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0b498792-92e0-4a98-9489-899016237459 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:14.687315 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0b498792-92e0-4a98-9489-899016237459 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:14.693340 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0b498792-92e0-4a98-9489-899016237459 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1752 microversion: 2.20 time: 0.540783 Jul 26 12:54:14.694194 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 198/384] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:14 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1752 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:54:15.719609 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-114b098f-5816-48bc-b4db-f9a413891e48 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:15.720438 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-114b098f-5816-48bc-b4db-f9a413891e48 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:15.734898 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-114b098f-5816-48bc-b4db-f9a413891e48 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:15.735922 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-114b098f-5816-48bc-b4db-f9a413891e48 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:15.739282 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-114b098f-5816-48bc-b4db-f9a413891e48 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:15.741842 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-114b098f-5816-48bc-b4db-f9a413891e48 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:16.313043 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-114b098f-5816-48bc-b4db-f9a413891e48 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:16.326636 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-114b098f-5816-48bc-b4db-f9a413891e48 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:16.341348 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-114b098f-5816-48bc-b4db-f9a413891e48 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:16.349322 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-114b098f-5816-48bc-b4db-f9a413891e48 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1752 microversion: 2.20 time: 0.630413 Jul 26 12:54:16.363664 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 187/385] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:15 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1752 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:17.379585 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1a1390d3-a8de-423f-98b7-bb90d40389a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:17.380321 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1a1390d3-a8de-423f-98b7-bb90d40389a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:17.406315 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1a1390d3-a8de-423f-98b7-bb90d40389a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:17.407466 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1a1390d3-a8de-423f-98b7-bb90d40389a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:17.409739 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1a1390d3-a8de-423f-98b7-bb90d40389a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:17.410348 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1a1390d3-a8de-423f-98b7-bb90d40389a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:17.467290 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:17.736983 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1a1390d3-a8de-423f-98b7-bb90d40389a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:17.746121 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1a1390d3-a8de-423f-98b7-bb90d40389a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:17.748980 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1a1390d3-a8de-423f-98b7-bb90d40389a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:17.749935 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1a1390d3-a8de-423f-98b7-bb90d40389a7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1754 microversion: 2.20 time: 0.379382 Jul 26 12:54:17.751369 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 199/386] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:17 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1754 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:18.776782 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d17c08cf-495b-4ec5-a6e7-df93c7a330e0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:18.778106 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d17c08cf-495b-4ec5-a6e7-df93c7a330e0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:18.788887 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d17c08cf-495b-4ec5-a6e7-df93c7a330e0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:18.789612 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d17c08cf-495b-4ec5-a6e7-df93c7a330e0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:18.790548 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d17c08cf-495b-4ec5-a6e7-df93c7a330e0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:18.790984 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d17c08cf-495b-4ec5-a6e7-df93c7a330e0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:18.995663 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d17c08cf-495b-4ec5-a6e7-df93c7a330e0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:19.036229 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d17c08cf-495b-4ec5-a6e7-df93c7a330e0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:19.037762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d17c08cf-495b-4ec5-a6e7-df93c7a330e0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:19.038942 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d17c08cf-495b-4ec5-a6e7-df93c7a330e0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1754 microversion: 2.20 time: 0.266285 Jul 26 12:54:19.052948 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 188/387] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:18 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1754 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:20.062575 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-2b666c45-69f2-4099-ba70-377f0c37e4a1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:20.063348 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-2b666c45-69f2-4099-ba70-377f0c37e4a1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:20.071000 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2b666c45-69f2-4099-ba70-377f0c37e4a1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:20.071575 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2b666c45-69f2-4099-ba70-377f0c37e4a1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:20.072482 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2b666c45-69f2-4099-ba70-377f0c37e4a1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:20.073181 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2b666c45-69f2-4099-ba70-377f0c37e4a1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:20.245073 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2b666c45-69f2-4099-ba70-377f0c37e4a1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:20.259495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2b666c45-69f2-4099-ba70-377f0c37e4a1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:20.261118 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2b666c45-69f2-4099-ba70-377f0c37e4a1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:20.262291 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-2b666c45-69f2-4099-ba70-377f0c37e4a1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1754 microversion: 2.20 time: 0.203673 Jul 26 12:54:20.266166 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 200/388] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:20 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1754 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:21.290237 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1530c7d4-9f25-4edf-b4e7-898211d2efc3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:21.290857 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1530c7d4-9f25-4edf-b4e7-898211d2efc3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:21.301581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1530c7d4-9f25-4edf-b4e7-898211d2efc3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:21.302045 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1530c7d4-9f25-4edf-b4e7-898211d2efc3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:21.302836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1530c7d4-9f25-4edf-b4e7-898211d2efc3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:21.303280 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1530c7d4-9f25-4edf-b4e7-898211d2efc3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:21.706361 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1530c7d4-9f25-4edf-b4e7-898211d2efc3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:21.724240 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:21.768829 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1530c7d4-9f25-4edf-b4e7-898211d2efc3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:21.773230 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1530c7d4-9f25-4edf-b4e7-898211d2efc3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:21.775300 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1530c7d4-9f25-4edf-b4e7-898211d2efc3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1754 microversion: 2.20 time: 0.489194 Jul 26 12:54:21.777028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 189/389] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:21 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1754 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:22.800276 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8e3f97c2-c3fa-48a5-8166-41f3c205acc5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:22.802503 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8e3f97c2-c3fa-48a5-8166-41f3c205acc5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:22.814395 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8e3f97c2-c3fa-48a5-8166-41f3c205acc5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:22.817811 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8e3f97c2-c3fa-48a5-8166-41f3c205acc5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:22.818803 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8e3f97c2-c3fa-48a5-8166-41f3c205acc5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:22.819397 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8e3f97c2-c3fa-48a5-8166-41f3c205acc5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:23.501764 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8e3f97c2-c3fa-48a5-8166-41f3c205acc5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:23.521896 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8e3f97c2-c3fa-48a5-8166-41f3c205acc5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:23.523446 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8e3f97c2-c3fa-48a5-8166-41f3c205acc5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:23.524692 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8e3f97c2-c3fa-48a5-8166-41f3c205acc5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1754 microversion: 2.20 time: 0.729563 Jul 26 12:54:23.525275 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 201/390] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:22 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1754 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:24.553245 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-36877d38-3a53-4c7b-a6f8-47a2f65aac55 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:24.554375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-36877d38-3a53-4c7b-a6f8-47a2f65aac55 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:24.587422 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-36877d38-3a53-4c7b-a6f8-47a2f65aac55 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:24.610506 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-36877d38-3a53-4c7b-a6f8-47a2f65aac55 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:24.614912 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-36877d38-3a53-4c7b-a6f8-47a2f65aac55 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:24.615374 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-36877d38-3a53-4c7b-a6f8-47a2f65aac55 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:25.510226 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-36877d38-3a53-4c7b-a6f8-47a2f65aac55 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:25.521638 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-36877d38-3a53-4c7b-a6f8-47a2f65aac55 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:25.531470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-36877d38-3a53-4c7b-a6f8-47a2f65aac55 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:25.534057 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-36877d38-3a53-4c7b-a6f8-47a2f65aac55 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1754 microversion: 2.20 time: 0.987034 Jul 26 12:54:25.535764 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 190/391] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:24 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1754 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:26.584736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c10ddd4c-37fb-47fb-967d-03694cb34620 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:26.589947 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c10ddd4c-37fb-47fb-967d-03694cb34620 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:26.614920 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c10ddd4c-37fb-47fb-967d-03694cb34620 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:26.622267 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c10ddd4c-37fb-47fb-967d-03694cb34620 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:26.623128 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c10ddd4c-37fb-47fb-967d-03694cb34620 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:26.625197 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c10ddd4c-37fb-47fb-967d-03694cb34620 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:26.992817 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c10ddd4c-37fb-47fb-967d-03694cb34620 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:27.017483 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c10ddd4c-37fb-47fb-967d-03694cb34620 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:27.020590 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c10ddd4c-37fb-47fb-967d-03694cb34620 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:27.022876 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c10ddd4c-37fb-47fb-967d-03694cb34620 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1754 microversion: 2.20 time: 0.450028 Jul 26 12:54:27.024061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 202/392] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:26 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1754 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:27.578175 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b663063e-7356-4262-b2ff-4bfaa131f1c0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Action: 'create', calling method: .version_select at 0x7f65f55484c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1387980769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJEHPgMeqh5o7k6VHaH+Mi4x5o+ByonFCmWhox7qjN4/1ia00VbbK3rAM0T8ZS9FEMf/pMJC521m4bNlycSJVGqcy/i/C5/VKV6Weogro8mnUIqlU8FfYiSXl5CqaXP/w=="}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:54:27.623856 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-b663063e-7356-4262-b2ff-4bfaa131f1c0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Getting quotas for project b8383c3af34e46f2922ffb7f6d4963af. Resources: {'key_pairs'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:54:27.635927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-b663063e-7356-4262-b2ff-4bfaa131f1c0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Getting quotas for user b6c556056d054689ab7b100f02404d3f and project b8383c3af34e46f2922ffb7f6d4963af. Resources: {'key_pairs'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:54:27.716375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b663063e-7356-4262-b2ff-4bfaa131f1c0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.490277 Jul 26 12:54:27.717168 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 191/393] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Jul 26 12:54:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:54:27.891045 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-117b209e-2235-4895-91d6-5c5c6f430698 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Action: 'create', calling method: .version_select at 0x7f65f534f5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1602648222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4+57aGk17kXULSSuCh4QaAxdER2qrtDmcPWVpDxqfQKcXZC2belFA6War/2eyD90eB9M5GS4StaMfdfUDybBEZfJ4sYMfdFNfzDz7tvh5/hunA0PG1Sija6B14W9KfHw=="}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:54:27.913851 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-117b209e-2235-4895-91d6-5c5c6f430698 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Getting quotas for project a2522985c6df452dabe2010e5f6bed35. Resources: {'key_pairs'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:54:27.923516 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-117b209e-2235-4895-91d6-5c5c6f430698 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Getting quotas for user 94efba410653451da2e9977d746633f6 and project a2522985c6df452dabe2010e5f6bed35. Resources: {'key_pairs'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:54:27.957342 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-117b209e-2235-4895-91d6-5c5c6f430698 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.283087 Jul 26 12:54:27.965023 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 203/394] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Jul 26 12:54:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:54:28.052084 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ceecd72d-d6cd-4468-a6cb-4fb8d07508f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:28.054120 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ceecd72d-d6cd-4468-a6cb-4fb8d07508f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:28.062701 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ceecd72d-d6cd-4468-a6cb-4fb8d07508f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:28.063365 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ceecd72d-d6cd-4468-a6cb-4fb8d07508f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:28.064351 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ceecd72d-d6cd-4468-a6cb-4fb8d07508f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:28.064945 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ceecd72d-d6cd-4468-a6cb-4fb8d07508f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:28.371289 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ceecd72d-d6cd-4468-a6cb-4fb8d07508f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:28.388652 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ceecd72d-d6cd-4468-a6cb-4fb8d07508f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:28.395702 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ceecd72d-d6cd-4468-a6cb-4fb8d07508f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:28.401992 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ceecd72d-d6cd-4468-a6cb-4fb8d07508f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1754 microversion: 2.20 time: 0.356752 Jul 26 12:54:28.404261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 192/395] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:28 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1754 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:29.447744 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-98c5e6bc-85be-489b-b659-7d3b990684b3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:29.449331 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-98c5e6bc-85be-489b-b659-7d3b990684b3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:29.458191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-98c5e6bc-85be-489b-b659-7d3b990684b3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:29.458979 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-98c5e6bc-85be-489b-b659-7d3b990684b3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:29.460037 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-98c5e6bc-85be-489b-b659-7d3b990684b3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:29.460697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-98c5e6bc-85be-489b-b659-7d3b990684b3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:29.792199 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-98c5e6bc-85be-489b-b659-7d3b990684b3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:29.801413 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-98c5e6bc-85be-489b-b659-7d3b990684b3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:29.804165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-98c5e6bc-85be-489b-b659-7d3b990684b3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:29.805447 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-98c5e6bc-85be-489b-b659-7d3b990684b3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.379628 Jul 26 12:54:29.821101 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 204/396] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:29 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:30.838729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-feccef08-ef5b-4ce6-9df7-0f4ecd4559ff tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:30.839577 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-feccef08-ef5b-4ce6-9df7-0f4ecd4559ff tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:30.846886 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-feccef08-ef5b-4ce6-9df7-0f4ecd4559ff tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:30.847557 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-feccef08-ef5b-4ce6-9df7-0f4ecd4559ff tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:30.848578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-feccef08-ef5b-4ce6-9df7-0f4ecd4559ff tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:30.849186 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-feccef08-ef5b-4ce6-9df7-0f4ecd4559ff tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:31.008816 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-feccef08-ef5b-4ce6-9df7-0f4ecd4559ff tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:31.020343 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-feccef08-ef5b-4ce6-9df7-0f4ecd4559ff tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:31.022552 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-feccef08-ef5b-4ce6-9df7-0f4ecd4559ff tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:31.024093 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-feccef08-ef5b-4ce6-9df7-0f4ecd4559ff tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.189318 Jul 26 12:54:31.024783 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 193/397] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:30 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:32.046488 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-4339c369-5a84-4628-92bb-aeacbd78156f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:32.047887 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-4339c369-5a84-4628-92bb-aeacbd78156f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:32.056681 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:32.062218 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4339c369-5a84-4628-92bb-aeacbd78156f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:32.072172 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4339c369-5a84-4628-92bb-aeacbd78156f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:32.073206 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4339c369-5a84-4628-92bb-aeacbd78156f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:32.073829 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4339c369-5a84-4628-92bb-aeacbd78156f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:32.383389 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-4339c369-5a84-4628-92bb-aeacbd78156f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:32.394189 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-4339c369-5a84-4628-92bb-aeacbd78156f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:32.395855 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-4339c369-5a84-4628-92bb-aeacbd78156f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:32.397373 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-4339c369-5a84-4628-92bb-aeacbd78156f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.354757 Jul 26 12:54:32.397996 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 205/398] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:32 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:54:33.437360 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-701dadf4-e2ce-4594-b033-05e877faf212 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:33.438711 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-701dadf4-e2ce-4594-b033-05e877faf212 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:33.446349 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-701dadf4-e2ce-4594-b033-05e877faf212 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:33.446621 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-701dadf4-e2ce-4594-b033-05e877faf212 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:33.447672 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-701dadf4-e2ce-4594-b033-05e877faf212 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:33.448197 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-701dadf4-e2ce-4594-b033-05e877faf212 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:33.641123 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-701dadf4-e2ce-4594-b033-05e877faf212 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:33.654436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-701dadf4-e2ce-4594-b033-05e877faf212 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:33.655998 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-701dadf4-e2ce-4594-b033-05e877faf212 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:33.657630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-701dadf4-e2ce-4594-b033-05e877faf212 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.231250 Jul 26 12:54:33.672314 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 194/399] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:33 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:34.695926 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-2632658a-de8c-4e25-871e-19b2b5722768 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:34.696640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-2632658a-de8c-4e25-871e-19b2b5722768 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:34.706567 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2632658a-de8c-4e25-871e-19b2b5722768 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:34.709654 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2632658a-de8c-4e25-871e-19b2b5722768 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:34.711252 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2632658a-de8c-4e25-871e-19b2b5722768 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:34.714879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2632658a-de8c-4e25-871e-19b2b5722768 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:34.909667 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2632658a-de8c-4e25-871e-19b2b5722768 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:34.919572 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2632658a-de8c-4e25-871e-19b2b5722768 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:34.921510 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2632658a-de8c-4e25-871e-19b2b5722768 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:34.922689 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-2632658a-de8c-4e25-871e-19b2b5722768 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.240217 Jul 26 12:54:34.923239 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 206/400] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:34 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:35.947342 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-db377670-665b-4626-bc43-f15a01c5548d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:35.947959 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-db377670-665b-4626-bc43-f15a01c5548d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:35.954501 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-db377670-665b-4626-bc43-f15a01c5548d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:35.954954 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-db377670-665b-4626-bc43-f15a01c5548d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:35.955756 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-db377670-665b-4626-bc43-f15a01c5548d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:35.956200 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-db377670-665b-4626-bc43-f15a01c5548d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:36.099092 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-db377670-665b-4626-bc43-f15a01c5548d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:36.107610 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-db377670-665b-4626-bc43-f15a01c5548d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:36.109229 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-db377670-665b-4626-bc43-f15a01c5548d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:36.110301 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-db377670-665b-4626-bc43-f15a01c5548d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.167068 Jul 26 12:54:36.110857 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 195/401] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:35 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:37.135592 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6a6fa096-1012-4315-bf17-d866cbb258dc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:37.136278 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6a6fa096-1012-4315-bf17-d866cbb258dc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:37.143763 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6a6fa096-1012-4315-bf17-d866cbb258dc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:37.144235 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6a6fa096-1012-4315-bf17-d866cbb258dc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:37.145557 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6a6fa096-1012-4315-bf17-d866cbb258dc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:37.146044 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6a6fa096-1012-4315-bf17-d866cbb258dc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:37.296126 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6a6fa096-1012-4315-bf17-d866cbb258dc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:37.309340 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6a6fa096-1012-4315-bf17-d866cbb258dc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:37.311013 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6a6fa096-1012-4315-bf17-d866cbb258dc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:37.312227 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6a6fa096-1012-4315-bf17-d866cbb258dc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.180892 Jul 26 12:54:37.312795 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 207/402] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:37 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:38.334900 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-08d3caf3-fc28-46bf-9576-39a019b8d52c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:38.335494 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-08d3caf3-fc28-46bf-9576-39a019b8d52c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:38.337966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=4 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:38.343922 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-08d3caf3-fc28-46bf-9576-39a019b8d52c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:38.344386 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-08d3caf3-fc28-46bf-9576-39a019b8d52c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:38.345160 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-08d3caf3-fc28-46bf-9576-39a019b8d52c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:38.345600 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-08d3caf3-fc28-46bf-9576-39a019b8d52c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:38.487701 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-08d3caf3-fc28-46bf-9576-39a019b8d52c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:38.497000 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-08d3caf3-fc28-46bf-9576-39a019b8d52c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:38.498509 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-08d3caf3-fc28-46bf-9576-39a019b8d52c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:38.499676 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-08d3caf3-fc28-46bf-9576-39a019b8d52c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.169014 Jul 26 12:54:38.500270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 196/403] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:38 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:39.524884 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-791f9141-f30b-4bc7-be48-efb8709db88c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:39.525451 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-791f9141-f30b-4bc7-be48-efb8709db88c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:39.527264 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=4 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:39.533381 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-791f9141-f30b-4bc7-be48-efb8709db88c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:39.533874 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-791f9141-f30b-4bc7-be48-efb8709db88c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:39.534647 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-791f9141-f30b-4bc7-be48-efb8709db88c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:39.535594 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-791f9141-f30b-4bc7-be48-efb8709db88c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:39.674239 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-791f9141-f30b-4bc7-be48-efb8709db88c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:39.684729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-791f9141-f30b-4bc7-be48-efb8709db88c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:39.686390 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-791f9141-f30b-4bc7-be48-efb8709db88c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:39.687735 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-791f9141-f30b-4bc7-be48-efb8709db88c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.166719 Jul 26 12:54:39.688364 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 208/404] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:39 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:40.723130 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ac35632a-2237-4632-8918-577a1b5ff0b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:40.724072 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ac35632a-2237-4632-8918-577a1b5ff0b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:40.733062 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ac35632a-2237-4632-8918-577a1b5ff0b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:40.733558 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ac35632a-2237-4632-8918-577a1b5ff0b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:40.734834 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ac35632a-2237-4632-8918-577a1b5ff0b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:40.735372 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ac35632a-2237-4632-8918-577a1b5ff0b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:40.888123 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ac35632a-2237-4632-8918-577a1b5ff0b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:40.896996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ac35632a-2237-4632-8918-577a1b5ff0b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:40.898814 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ac35632a-2237-4632-8918-577a1b5ff0b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:40.900327 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ac35632a-2237-4632-8918-577a1b5ff0b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.182556 Jul 26 12:54:40.900913 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 197/405] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:40 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:40.968934 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-206563fc-e240-4ccb-b14f-d79265fbce42 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:40.969473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-206563fc-e240-4ccb-b14f-d79265fbce42 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:40.976729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-206563fc-e240-4ccb-b14f-d79265fbce42 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:40.977113 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-206563fc-e240-4ccb-b14f-d79265fbce42 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:40.977883 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-206563fc-e240-4ccb-b14f-d79265fbce42 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:40.978324 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-206563fc-e240-4ccb-b14f-d79265fbce42 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:41.115006 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-206563fc-e240-4ccb-b14f-d79265fbce42 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lazy-loading 'services' on Instance uuid dbf15f1d-311d-4b62-a80c-6668706d2a67 {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:54:41.235014 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-206563fc-e240-4ccb-b14f-d79265fbce42 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67/os-volume_attachments/97b4ccd8-1a9b-4847-ac5a-d97ca7cb4fa2" status: 202 len: 0 microversion: 2.1 time: 0.270289 Jul 26 12:54:41.235569 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 209/406] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Jul 26 12:54:40 2022] DELETE /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67/os-volume_attachments/97b4ccd8-1a9b-4847-ac5a-d97ca7cb4fa2 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:54:41.925536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-71297eb0-477d-4bb7-9efc-b97b1ee48cb1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:41.926712 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-71297eb0-477d-4bb7-9efc-b97b1ee48cb1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:41.929127 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:41.935093 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-71297eb0-477d-4bb7-9efc-b97b1ee48cb1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:41.935618 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-71297eb0-477d-4bb7-9efc-b97b1ee48cb1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:41.936652 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-71297eb0-477d-4bb7-9efc-b97b1ee48cb1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:41.937103 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-71297eb0-477d-4bb7-9efc-b97b1ee48cb1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:42.084298 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-71297eb0-477d-4bb7-9efc-b97b1ee48cb1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:42.094257 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-71297eb0-477d-4bb7-9efc-b97b1ee48cb1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:42.095698 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-71297eb0-477d-4bb7-9efc-b97b1ee48cb1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:42.096907 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-71297eb0-477d-4bb7-9efc-b97b1ee48cb1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.175280 Jul 26 12:54:42.097508 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 198/407] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:41 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:54:42.366940 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-443393a6-8793-4265-97a4-396d4a96a3b4 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:42.367524 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-443393a6-8793-4265-97a4-396d4a96a3b4 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:42.374673 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-443393a6-8793-4265-97a4-396d4a96a3b4 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:42.375129 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-443393a6-8793-4265-97a4-396d4a96a3b4 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:42.376214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-443393a6-8793-4265-97a4-396d4a96a3b4 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:42.376653 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-443393a6-8793-4265-97a4-396d4a96a3b4 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:42.402554 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-443393a6-8793-4265-97a4-396d4a96a3b4 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Going to try to terminate instance {{(pid=129308) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:54:42.481662 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-443393a6-8793-4265-97a4-396d4a96a3b4 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 204 len: 0 microversion: 2.1 time: 0.120010 Jul 26 12:54:42.482244 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 210/408] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:54:42 2022] DELETE /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:54:42.492236 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4bac93e3-3fd0-4f1d-9394-d493eb7a741c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:42.492951 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4bac93e3-3fd0-4f1d-9394-d493eb7a741c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:42.499361 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4bac93e3-3fd0-4f1d-9394-d493eb7a741c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:42.499855 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4bac93e3-3fd0-4f1d-9394-d493eb7a741c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:42.500624 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4bac93e3-3fd0-4f1d-9394-d493eb7a741c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:42.501309 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4bac93e3-3fd0-4f1d-9394-d493eb7a741c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:42.644342 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4bac93e3-3fd0-4f1d-9394-d493eb7a741c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:42.651817 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4bac93e3-3fd0-4f1d-9394-d493eb7a741c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1514 microversion: 2.1 time: 0.165150 Jul 26 12:54:42.652380 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 199/409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:54:42 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:54:43.121736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7f16f7c3-4ff4-443d-9053-56177eda4224 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:43.122418 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7f16f7c3-4ff4-443d-9053-56177eda4224 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:43.129186 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7f16f7c3-4ff4-443d-9053-56177eda4224 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:43.129619 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7f16f7c3-4ff4-443d-9053-56177eda4224 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:43.130369 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7f16f7c3-4ff4-443d-9053-56177eda4224 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:43.130797 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7f16f7c3-4ff4-443d-9053-56177eda4224 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:43.268616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7f16f7c3-4ff4-443d-9053-56177eda4224 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:43.278303 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7f16f7c3-4ff4-443d-9053-56177eda4224 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:43.280075 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7f16f7c3-4ff4-443d-9053-56177eda4224 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:43.281447 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7f16f7c3-4ff4-443d-9053-56177eda4224 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.164027 Jul 26 12:54:43.282011 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 211/410] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:43 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:43.673400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-eb0aa3c8-3914-41e3-8d50-0af19b201e0c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:43.674013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-eb0aa3c8-3914-41e3-8d50-0af19b201e0c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:43.681058 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eb0aa3c8-3914-41e3-8d50-0af19b201e0c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:43.681508 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eb0aa3c8-3914-41e3-8d50-0af19b201e0c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:43.682344 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eb0aa3c8-3914-41e3-8d50-0af19b201e0c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:43.682783 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eb0aa3c8-3914-41e3-8d50-0af19b201e0c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:43.834878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-eb0aa3c8-3914-41e3-8d50-0af19b201e0c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:43.844709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-eb0aa3c8-3914-41e3-8d50-0af19b201e0c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1514 microversion: 2.1 time: 0.175313 Jul 26 12:54:43.845275 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 200/411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:54:43 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:54:44.304398 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c34ed803-d521-4d94-89c8-39dc9659083a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:44.304990 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c34ed803-d521-4d94-89c8-39dc9659083a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:44.311332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c34ed803-d521-4d94-89c8-39dc9659083a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:44.311818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c34ed803-d521-4d94-89c8-39dc9659083a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:44.312575 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c34ed803-d521-4d94-89c8-39dc9659083a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:44.313009 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c34ed803-d521-4d94-89c8-39dc9659083a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:44.481416 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c34ed803-d521-4d94-89c8-39dc9659083a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:44.490924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c34ed803-d521-4d94-89c8-39dc9659083a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:44.492444 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c34ed803-d521-4d94-89c8-39dc9659083a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:44.493627 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c34ed803-d521-4d94-89c8-39dc9659083a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.193094 Jul 26 12:54:44.494194 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 212/412] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:44 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:44.869572 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-199e5782-20cf-4fe7-bf2d-6e8c736d268e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:44.870383 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-199e5782-20cf-4fe7-bf2d-6e8c736d268e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:44.879372 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-199e5782-20cf-4fe7-bf2d-6e8c736d268e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:44.880048 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-199e5782-20cf-4fe7-bf2d-6e8c736d268e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:44.880994 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-199e5782-20cf-4fe7-bf2d-6e8c736d268e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:44.881606 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-199e5782-20cf-4fe7-bf2d-6e8c736d268e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:44.958387 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-199e5782-20cf-4fe7-bf2d-6e8c736d268e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:44.967290 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-199e5782-20cf-4fe7-bf2d-6e8c736d268e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 200 len: 1472 microversion: 2.1 time: 0.101778 Jul 26 12:54:44.968058 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 201/413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:54:44 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 1472 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:54:44.972299 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-d40d2e29-bbaa-4104-858c-0b7cc6c68262 req-e6017b48-b2b4-4be4-8ab0-148776fb4bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf15f1d-311d-4b62-a80c-6668706d2a67", "name": "network-vif-deleted", "tag": "9b013626-dcc3-4a6a-84ce-6c100ca71a7e"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:54:44.983366 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-d40d2e29-bbaa-4104-858c-0b7cc6c68262 req-e6017b48-b2b4-4be4-8ab0-148776fb4bdc service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:44.983852 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-d40d2e29-bbaa-4104-858c-0b7cc6c68262 req-e6017b48-b2b4-4be4-8ab0-148776fb4bdc service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:44.996237 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-d40d2e29-bbaa-4104-858c-0b7cc6c68262 req-e6017b48-b2b4-4be4-8ab0-148776fb4bdc service nova] Creating event network-vif-deleted:9b013626-dcc3-4a6a-84ce-6c100ca71a7e for instance dbf15f1d-311d-4b62-a80c-6668706d2a67 on hv-cinder-85093 Jul 26 12:54:45.002231 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-d40d2e29-bbaa-4104-858c-0b7cc6c68262 req-e6017b48-b2b4-4be4-8ab0-148776fb4bdc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033726 Jul 26 12:54:45.002832 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 213/414] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:54:45.516729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-69b4ccc0-6314-43a7-a180-b79b1b9cf62d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:45.517248 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-69b4ccc0-6314-43a7-a180-b79b1b9cf62d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:45.523295 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69b4ccc0-6314-43a7-a180-b79b1b9cf62d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:45.523776 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69b4ccc0-6314-43a7-a180-b79b1b9cf62d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:45.524550 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69b4ccc0-6314-43a7-a180-b79b1b9cf62d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:45.524990 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69b4ccc0-6314-43a7-a180-b79b1b9cf62d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:45.656105 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-69b4ccc0-6314-43a7-a180-b79b1b9cf62d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:45.665050 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-69b4ccc0-6314-43a7-a180-b79b1b9cf62d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:45.666566 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-69b4ccc0-6314-43a7-a180-b79b1b9cf62d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:45.667953 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-69b4ccc0-6314-43a7-a180-b79b1b9cf62d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.155250 Jul 26 12:54:45.668622 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 202/415] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:45 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:45.990910 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e10e9dfc-bcfa-4b90-81f4-ab941b39945e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:45.991646 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e10e9dfc-bcfa-4b90-81f4-ab941b39945e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: dbf15f1d-311d-4b62-a80c-6668706d2a67] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:45.997904 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e10e9dfc-bcfa-4b90-81f4-ab941b39945e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:45.998357 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e10e9dfc-bcfa-4b90-81f4-ab941b39945e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:45.999117 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e10e9dfc-bcfa-4b90-81f4-ab941b39945e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:45.999556 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e10e9dfc-bcfa-4b90-81f4-ab941b39945e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:46.013138 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-e10e9dfc-bcfa-4b90-81f4-ab941b39945e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] HTTP exception thrown: Instance dbf15f1d-311d-4b62-a80c-6668706d2a67 could not be found. Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e10e9dfc-bcfa-4b90-81f4-ab941b39945e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Request method failure captured: Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 HTTP/1.1 Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-O-f42IcWxDs9uAesIjlEGDyOwLpuU4gT_2kdIYkBH1XW9Qwf5kEZX0mkN5Fk-XDbaWJwIPrM8uSNGeMIYopShNsxWhyXzpTRfpl_tGzTjogaRmA82Dh8SaA5xw33ZFQjgjmv0LfKQVVeagUMww2fUNPU4N3OwJdkEc3-Iq2ZjMvoQ Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: fa4a3dadafc44483ad16923db53db457 Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1919758244 Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:54:46.014863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:54:46.016388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fa4a3dadafc44483ad16923db53db457"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fa4a3dadafc44483ad16923db53db457", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fa4a3dadafc44483ad16923db53db457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fa4a3dadafc44483ad16923db53db457"}]}] Jul 26 12:54:46.016388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-VolumesSnapshotTestJSON-1919758244 Jul 26 12:54:46.016388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: fa4a3dadafc44483ad16923db53db457 Jul 26 12:54:46.016388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1919758244 Jul 26 12:54:46.016388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-VolumesSnapshotTestJSON-1919758244-project Jul 26 12:54:46.016388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:54:46.016388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:54:46.016388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 7a6832c70c0c401985bc4f26a787080f Jul 26 12:54:46.016388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-VolumesSnapshotTestJSON-1919758244-project Jul 26 12:54:46.016388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:54:46.016388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance dbf15f1d-311d-4b62-a80c-6668706d2a67 could not be found. Jul 26 12:54:46.016388 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': 'dbf15f1d-311d-4b62-a80c-6668706d2a67'} Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf15f1d-311d-4b62-a80c-6668706d2a67 could not be found. Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:54:46.017198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf15f1d-311d-4b62-a80c-6668706d2a67 could not be found. Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf15f1d-311d-4b62-a80c-6668706d2a67 could not be found. Jul 26 12:54:46.018576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:54:46.020290 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e10e9dfc-bcfa-4b90-81f4-ab941b39945e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Returning 404 to user: Instance dbf15f1d-311d-4b62-a80c-6668706d2a67 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:54:46.020290 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e10e9dfc-bcfa-4b90-81f4-ab941b39945e tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67" status: 404 len: 111 microversion: 2.1 time: 0.030127 Jul 26 12:54:46.020290 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 214/416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:54:45 2022] GET /compute/v2.1/servers/dbf15f1d-311d-4b62-a80c-6668706d2a67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:54:46.693029 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e05adfda-2eed-49e8-95cb-42669a5571ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:46.693664 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e05adfda-2eed-49e8-95cb-42669a5571ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:46.700316 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e05adfda-2eed-49e8-95cb-42669a5571ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:46.700759 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e05adfda-2eed-49e8-95cb-42669a5571ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:46.701522 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e05adfda-2eed-49e8-95cb-42669a5571ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:46.701950 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e05adfda-2eed-49e8-95cb-42669a5571ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:46.834851 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e05adfda-2eed-49e8-95cb-42669a5571ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:46.843354 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e05adfda-2eed-49e8-95cb-42669a5571ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:46.844927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e05adfda-2eed-49e8-95cb-42669a5571ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:46.846251 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e05adfda-2eed-49e8-95cb-42669a5571ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.157663 Jul 26 12:54:46.846813 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 203/417] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:46 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:47.870578 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f2705a10-6081-45e5-b3d7-830a534bad11 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:47.871214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f2705a10-6081-45e5-b3d7-830a534bad11 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:47.879412 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f2705a10-6081-45e5-b3d7-830a534bad11 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:47.879885 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f2705a10-6081-45e5-b3d7-830a534bad11 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:47.880644 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f2705a10-6081-45e5-b3d7-830a534bad11 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:47.881070 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f2705a10-6081-45e5-b3d7-830a534bad11 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:47.886258 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:48.024348 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f2705a10-6081-45e5-b3d7-830a534bad11 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:48.034101 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f2705a10-6081-45e5-b3d7-830a534bad11 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:48.035556 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f2705a10-6081-45e5-b3d7-830a534bad11 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:48.036763 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f2705a10-6081-45e5-b3d7-830a534bad11 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.170113 Jul 26 12:54:48.037320 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 215/418] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:47 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:49.060030 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e04658fc-40ae-4134-a73f-b43666c59314 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:49.060672 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e04658fc-40ae-4134-a73f-b43666c59314 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:49.067829 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e04658fc-40ae-4134-a73f-b43666c59314 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:49.068293 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e04658fc-40ae-4134-a73f-b43666c59314 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:49.069068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e04658fc-40ae-4134-a73f-b43666c59314 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:49.069510 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e04658fc-40ae-4134-a73f-b43666c59314 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:49.197365 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e04658fc-40ae-4134-a73f-b43666c59314 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:49.205642 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e04658fc-40ae-4134-a73f-b43666c59314 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:49.207859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e04658fc-40ae-4134-a73f-b43666c59314 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:49.208991 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e04658fc-40ae-4134-a73f-b43666c59314 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.153012 Jul 26 12:54:49.209551 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 204/419] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:49 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:50.231085 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-4510c3d8-e389-42e1-a67d-28449164e88f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:50.231663 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-4510c3d8-e389-42e1-a67d-28449164e88f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:50.238894 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4510c3d8-e389-42e1-a67d-28449164e88f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:50.239345 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4510c3d8-e389-42e1-a67d-28449164e88f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:50.240237 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4510c3d8-e389-42e1-a67d-28449164e88f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:50.240683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4510c3d8-e389-42e1-a67d-28449164e88f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:50.413268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-4510c3d8-e389-42e1-a67d-28449164e88f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:50.422017 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-4510c3d8-e389-42e1-a67d-28449164e88f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:50.423514 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-4510c3d8-e389-42e1-a67d-28449164e88f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:50.424740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-4510c3d8-e389-42e1-a67d-28449164e88f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.197562 Jul 26 12:54:50.425274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 216/420] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:50 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:51.456421 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2ffcbe81-61b7-4987-b6f6-ed573bd6c045 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:51.458649 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2ffcbe81-61b7-4987-b6f6-ed573bd6c045 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:51.466788 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2ffcbe81-61b7-4987-b6f6-ed573bd6c045 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:51.467614 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2ffcbe81-61b7-4987-b6f6-ed573bd6c045 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:51.468972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2ffcbe81-61b7-4987-b6f6-ed573bd6c045 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:51.469631 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2ffcbe81-61b7-4987-b6f6-ed573bd6c045 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:51.618100 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2ffcbe81-61b7-4987-b6f6-ed573bd6c045 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:51.628128 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2ffcbe81-61b7-4987-b6f6-ed573bd6c045 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:51.630979 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2ffcbe81-61b7-4987-b6f6-ed573bd6c045 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:51.632476 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2ffcbe81-61b7-4987-b6f6-ed573bd6c045 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.180830 Jul 26 12:54:51.648154 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 205/421] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:51 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:52.657368 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5571b008-55b7-4066-b125-d8c0804222a0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:52.658006 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-5571b008-55b7-4066-b125-d8c0804222a0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:52.665101 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5571b008-55b7-4066-b125-d8c0804222a0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:52.665544 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5571b008-55b7-4066-b125-d8c0804222a0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:52.666306 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5571b008-55b7-4066-b125-d8c0804222a0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:52.666731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5571b008-55b7-4066-b125-d8c0804222a0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:52.806915 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-5571b008-55b7-4066-b125-d8c0804222a0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:52.817207 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-5571b008-55b7-4066-b125-d8c0804222a0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:52.818798 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-5571b008-55b7-4066-b125-d8c0804222a0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:52.820012 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-5571b008-55b7-4066-b125-d8c0804222a0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.166487 Jul 26 12:54:52.820564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 217/422] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:52 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:53.842750 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-bd977334-3e3c-4eab-b45d-b3f5fc052fca tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:53.843402 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-bd977334-3e3c-4eab-b45d-b3f5fc052fca tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:53.850601 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bd977334-3e3c-4eab-b45d-b3f5fc052fca tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:53.851056 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bd977334-3e3c-4eab-b45d-b3f5fc052fca tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:53.851876 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bd977334-3e3c-4eab-b45d-b3f5fc052fca tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:53.852362 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bd977334-3e3c-4eab-b45d-b3f5fc052fca tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:54.003913 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bd977334-3e3c-4eab-b45d-b3f5fc052fca tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:54.012568 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bd977334-3e3c-4eab-b45d-b3f5fc052fca tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:54.014065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bd977334-3e3c-4eab-b45d-b3f5fc052fca tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:54.015239 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-bd977334-3e3c-4eab-b45d-b3f5fc052fca tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.176512 Jul 26 12:54:54.015959 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 206/423] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:53 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:55.041084 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3597ec75-47c7-43cc-bbfa-db060b2276fc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:55.041722 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3597ec75-47c7-43cc-bbfa-db060b2276fc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:55.048156 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3597ec75-47c7-43cc-bbfa-db060b2276fc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:55.048606 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3597ec75-47c7-43cc-bbfa-db060b2276fc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:55.049363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3597ec75-47c7-43cc-bbfa-db060b2276fc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:55.049794 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3597ec75-47c7-43cc-bbfa-db060b2276fc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:55.192018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3597ec75-47c7-43cc-bbfa-db060b2276fc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:55.204168 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3597ec75-47c7-43cc-bbfa-db060b2276fc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:55.206573 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3597ec75-47c7-43cc-bbfa-db060b2276fc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:55.208703 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3597ec75-47c7-43cc-bbfa-db060b2276fc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.171492 Jul 26 12:54:55.209509 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 218/424] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:55 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:56.089622 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-998033668", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "networks": [{"uuid": "6f3c6a72-7f77-4ac8-bef3-87195153f5df"}]}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:54:56.144578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.network.neutron [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] validate_networks() for [('6f3c6a72-7f77-4ac8-bef3-87195153f5df', None, None, None, None, None)] {{(pid=129307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:54:56.232003 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-90a3305e-58b1-477a-923a-4eb49e00726a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:56.233417 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-90a3305e-58b1-477a-923a-4eb49e00726a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:56.241182 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-90a3305e-58b1-477a-923a-4eb49e00726a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:56.241924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-90a3305e-58b1-477a-923a-4eb49e00726a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:56.243621 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-90a3305e-58b1-477a-923a-4eb49e00726a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:56.244436 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-90a3305e-58b1-477a-923a-4eb49e00726a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:56.406157 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-90a3305e-58b1-477a-923a-4eb49e00726a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:56.417699 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-90a3305e-58b1-477a-923a-4eb49e00726a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:56.419696 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-90a3305e-58b1-477a-923a-4eb49e00726a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:56.421055 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-90a3305e-58b1-477a-923a-4eb49e00726a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.192928 Jul 26 12:54:56.421771 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 219/425] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:56 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:54:56.546126 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Flavor limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:54:56.546546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Image limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:54:56.547015 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Flavor pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:54:56.547419 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Image pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:54:56.547857 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:54:56.557470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:56.557907 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:56.558771 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:56.559203 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:56.565704 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=98 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:54:56.576956 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Getting quotas for project fa4a3dadafc44483ad16923db53db457. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:54:56.581098 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Getting quotas for user 7a6832c70c0c401985bc4f26a787080f and project fa4a3dadafc44483ad16923db53db457. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:54:56.592624 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Going to run 1 instances... {{(pid=129307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:54:56.594862 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:54:56.651195 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c5e60f70-e9f0-49ed-8d86-8ce4017e5bf0 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566084 Jul 26 12:54:56.651877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 207/426] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:54:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 12:54:56.662496 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a64a2274-809d-44c3-bf03-4e2a9ea2c564 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:56.663115 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-a64a2274-809d-44c3-bf03-4e2a9ea2c564 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:56.719202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-a64a2274-809d-44c3-bf03-4e2a9ea2c564 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:56.726631 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a64a2274-809d-44c3-bf03-4e2a9ea2c564 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1218 microversion: 2.1 time: 0.067796 Jul 26 12:54:56.727671 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 220/427] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:54:56 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:54:57.445900 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-147b9391-147f-437a-ac88-75c1fc54a6f3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:57.447271 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-147b9391-147f-437a-ac88-75c1fc54a6f3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:57.454615 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-147b9391-147f-437a-ac88-75c1fc54a6f3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:57.455312 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-147b9391-147f-437a-ac88-75c1fc54a6f3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:57.456290 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-147b9391-147f-437a-ac88-75c1fc54a6f3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:57.457031 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-147b9391-147f-437a-ac88-75c1fc54a6f3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:57.599533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-147b9391-147f-437a-ac88-75c1fc54a6f3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:57.623607 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-147b9391-147f-437a-ac88-75c1fc54a6f3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:57.630191 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-147b9391-147f-437a-ac88-75c1fc54a6f3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:57.634890 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-147b9391-147f-437a-ac88-75c1fc54a6f3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.191717 Jul 26 12:54:57.635909 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 208/428] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:57 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:54:57.653999 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7c04d4c7-2dfd-428e-b34d-7424c1c2dbc6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fc334ca-2ead-405a-a4cd-68c5af120a2b"}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:54:57.656440 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7c04d4c7-2dfd-428e-b34d-7424c1c2dbc6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:57.665088 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c04d4c7-2dfd-428e-b34d-7424c1c2dbc6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:57.665545 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c04d4c7-2dfd-428e-b34d-7424c1c2dbc6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:57.666363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c04d4c7-2dfd-428e-b34d-7424c1c2dbc6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:57.666802 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c04d4c7-2dfd-428e-b34d-7424c1c2dbc6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:57.748660 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-384e05fa-6568-486f-8cda-93c6e1a65dcb tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:57.749378 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-384e05fa-6568-486f-8cda-93c6e1a65dcb tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:57.755709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-384e05fa-6568-486f-8cda-93c6e1a65dcb tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:57.756159 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-384e05fa-6568-486f-8cda-93c6e1a65dcb tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:57.756920 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-384e05fa-6568-486f-8cda-93c6e1a65dcb tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:57.757352 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-384e05fa-6568-486f-8cda-93c6e1a65dcb tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:57.824059 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-384e05fa-6568-486f-8cda-93c6e1a65dcb tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:57.834972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-384e05fa-6568-486f-8cda-93c6e1a65dcb tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1222 microversion: 2.1 time: 0.089842 Jul 26 12:54:57.857045 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 209/429] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:54:57 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:54:58.658046 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d3c5a2ce-8a0f-496c-baf3-e44112d26b65 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:58.658825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d3c5a2ce-8a0f-496c-baf3-e44112d26b65 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:58.665700 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d3c5a2ce-8a0f-496c-baf3-e44112d26b65 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:58.666146 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d3c5a2ce-8a0f-496c-baf3-e44112d26b65 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:58.666904 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d3c5a2ce-8a0f-496c-baf3-e44112d26b65 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:58.667342 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d3c5a2ce-8a0f-496c-baf3-e44112d26b65 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:58.801200 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d3c5a2ce-8a0f-496c-baf3-e44112d26b65 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:58.809955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d3c5a2ce-8a0f-496c-baf3-e44112d26b65 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:58.811451 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d3c5a2ce-8a0f-496c-baf3-e44112d26b65 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:58.812634 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d3c5a2ce-8a0f-496c-baf3-e44112d26b65 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.158507 Jul 26 12:54:58.813193 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 210/430] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:58 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:54:58.863623 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-aa6cf0d9-527d-40e7-abf3-14534c700897 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:58.864376 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-aa6cf0d9-527d-40e7-abf3-14534c700897 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:58.875918 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-aa6cf0d9-527d-40e7-abf3-14534c700897 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:58.876628 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-aa6cf0d9-527d-40e7-abf3-14534c700897 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:58.877462 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-aa6cf0d9-527d-40e7-abf3-14534c700897 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:58.877907 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-aa6cf0d9-527d-40e7-abf3-14534c700897 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:58.945796 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-aa6cf0d9-527d-40e7-abf3-14534c700897 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:54:58.954966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-aa6cf0d9-527d-40e7-abf3-14534c700897 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1222 microversion: 2.1 time: 0.095606 Jul 26 12:54:58.958542 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 211/431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:54:58 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:54:59.836719 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f450b94c-3d0e-4789-85b6-483d01b87d18 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:54:59.837443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f450b94c-3d0e-4789-85b6-483d01b87d18 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:54:59.844351 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f450b94c-3d0e-4789-85b6-483d01b87d18 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:59.845064 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f450b94c-3d0e-4789-85b6-483d01b87d18 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:54:59.846028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f450b94c-3d0e-4789-85b6-483d01b87d18 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:54:59.846560 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f450b94c-3d0e-4789-85b6-483d01b87d18 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:00.002593 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f450b94c-3d0e-4789-85b6-483d01b87d18 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:00.011478 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f450b94c-3d0e-4789-85b6-483d01b87d18 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:00.013121 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f450b94c-3d0e-4789-85b6-483d01b87d18 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:00.014352 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f450b94c-3d0e-4789-85b6-483d01b87d18 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.181634 Jul 26 12:55:00.014909 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 212/432] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:54:59 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:55:00.020068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9040a63c-b570-470c-b8d3-45737cccc4a6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:00.020742 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9040a63c-b570-470c-b8d3-45737cccc4a6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:00.027545 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9040a63c-b570-470c-b8d3-45737cccc4a6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:00.028131 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9040a63c-b570-470c-b8d3-45737cccc4a6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:00.028862 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9040a63c-b570-470c-b8d3-45737cccc4a6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:00.029385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9040a63c-b570-470c-b8d3-45737cccc4a6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:00.092559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9040a63c-b570-470c-b8d3-45737cccc4a6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:00.101192 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9040a63c-b570-470c-b8d3-45737cccc4a6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1222 microversion: 2.1 time: 0.085303 Jul 26 12:55:00.101787 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 213/433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:00 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:00.113234 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2005214972", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1602648222", "security_groups": [{"name": "tempest-secgroup-smoke-1409511889"}], "block_device_mapping_v2": [{"uuid": "8c031615-2da1-41da-bf24-0d5279bef175", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8b53c01d-8651-463b-8de8-06dcdf11a64f"}]}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:00.225243 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.network.neutron [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] validate_networks() for [('8b53c01d-8651-463b-8de8-06dcdf11a64f', None, None, None, None, None)] {{(pid=129307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:55:00.596102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Flavor limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:55:00.596524 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Image limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:55:00.597178 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Flavor pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:55:00.597414 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Image pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:55:00.597815 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:55:00.607588 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:00.608102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:00.608970 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:00.609452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:00.627672 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Getting quotas for project a2522985c6df452dabe2010e5f6bed35. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:55:00.631997 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Getting quotas for user 94efba410653451da2e9977d746633f6 and project a2522985c6df452dabe2010e5f6bed35. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:55:00.694479 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Going to run 1 instances... {{(pid=129307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:55:00.697253 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c031615-2da1-41da-bf24-0d5279bef175',volume_size=None,volume_type=None)] {{(pid=129307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:55:00.724371 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7c04d4c7-2dfd-428e-b34d-7424c1c2dbc6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "POST /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.074075 Jul 26 12:55:00.725103 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 221/434] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 12:54:57 2022] POST /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-volume_attachments => generated 194 bytes in 3076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:55:00.730148 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2119888803", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1387980769", "security_groups": [{"name": "tempest-secgroup-smoke-1807677125"}], "networks": [{"uuid": "a4f56cd7-c0c8-4d76-9608-89effa75e9c4"}], "block_device_mapping_v2": [{"uuid": "6c947700-e45d-4c37-b493-dca6a2f0adb2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:00.839338 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d8bb63b1-bc15-41db-aa48-d6c85b7302e5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730028 Jul 26 12:55:00.840047 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 214/435] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:55:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 12:55:00.851327 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-a52d3302-1391-4848-88af-a31e69e78a9c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:00.852129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-a52d3302-1391-4848-88af-a31e69e78a9c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:00.884434 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.network.neutron [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] validate_networks() for [('a4f56cd7-c0c8-4d76-9608-89effa75e9c4', None, None, None, None, None)] {{(pid=129308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:55:00.917889 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-a52d3302-1391-4848-88af-a31e69e78a9c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:00.926161 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-a52d3302-1391-4848-88af-a31e69e78a9c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1095 microversion: 2.1 time: 0.078780 Jul 26 12:55:00.926729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 215/436] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:00 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:01.042352 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-805d405c-5adf-4e55-95df-286ce19a66aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:01.043003 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-805d405c-5adf-4e55-95df-286ce19a66aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:01.049238 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-805d405c-5adf-4e55-95df-286ce19a66aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:01.049694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-805d405c-5adf-4e55-95df-286ce19a66aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:01.051055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-805d405c-5adf-4e55-95df-286ce19a66aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:01.051718 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-805d405c-5adf-4e55-95df-286ce19a66aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:01.236781 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-805d405c-5adf-4e55-95df-286ce19a66aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:01.246876 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-805d405c-5adf-4e55-95df-286ce19a66aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:01.248725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-805d405c-5adf-4e55-95df-286ce19a66aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:01.249924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-805d405c-5adf-4e55-95df-286ce19a66aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.215245 Jul 26 12:55:01.268842 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 216/437] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:01 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:55:01.276268 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1a1ef21f-5bf7-4b25-9edd-8ac1ed3a35c6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:01.277387 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1a1ef21f-5bf7-4b25-9edd-8ac1ed3a35c6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:01.286030 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1a1ef21f-5bf7-4b25-9edd-8ac1ed3a35c6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:01.286603 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1a1ef21f-5bf7-4b25-9edd-8ac1ed3a35c6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:01.287549 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1a1ef21f-5bf7-4b25-9edd-8ac1ed3a35c6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:01.288397 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1a1ef21f-5bf7-4b25-9edd-8ac1ed3a35c6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:01.358497 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Flavor limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:55:01.358924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Image limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:55:01.359402 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Flavor pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:55:01.360093 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Image pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:55:01.360515 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:55:01.369856 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:01.370310 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:01.371104 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:01.371544 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:01.377192 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1a1ef21f-5bf7-4b25-9edd-8ac1ed3a35c6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:01.387769 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1a1ef21f-5bf7-4b25-9edd-8ac1ed3a35c6 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1270 microversion: 2.1 time: 0.116345 Jul 26 12:55:01.388631 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 217/438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:01 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1270 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:01.397810 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Getting quotas for project b8383c3af34e46f2922ffb7f6d4963af. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:55:01.402311 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Getting quotas for user b6c556056d054689ab7b100f02404d3f and project b8383c3af34e46f2922ffb7f6d4963af. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:55:01.464620 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Going to run 1 instances... {{(pid=129308) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:55:01.466938 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c947700-e45d-4c37-b493-dca6a2f0adb2',volume_size=None,volume_type=None)] {{(pid=129308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:55:01.601762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6d13c3b8-ab15-4570-8ce6-0bd12d26abc3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.874906 Jul 26 12:55:01.602348 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 222/439] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:55:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 12:55:01.614997 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8b0bac6d-a326-44a0-8547-e5e9660f66b8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:01.616069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8b0bac6d-a326-44a0-8547-e5e9660f66b8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:01.685561 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8b0bac6d-a326-44a0-8547-e5e9660f66b8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:01.695094 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8b0bac6d-a326-44a0-8547-e5e9660f66b8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1089 microversion: 2.1 time: 0.085013 Jul 26 12:55:01.696247 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 218/440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:01 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1089 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:01.848445 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ad1f24bd-b7f2-45e1-bebb-31df69ff00fa tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:01.849886 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ad1f24bd-b7f2-45e1-bebb-31df69ff00fa tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:01.863707 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ad1f24bd-b7f2-45e1-bebb-31df69ff00fa tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:01.864505 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ad1f24bd-b7f2-45e1-bebb-31df69ff00fa tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:01.866355 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ad1f24bd-b7f2-45e1-bebb-31df69ff00fa tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:01.866984 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ad1f24bd-b7f2-45e1-bebb-31df69ff00fa tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:01.914382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ad1f24bd-b7f2-45e1-bebb-31df69ff00fa tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b/ips" status: 200 len: 150 microversion: 2.1 time: 0.072701 Jul 26 12:55:01.917392 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 223/441] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Jul 26 12:55:01 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b/ips => generated 150 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:55:01.930661 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-53020e45-b498-4f5c-a9b1-532fc18ba861 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65fc12ea-eb12-4dee-bf90-2ccff6640c7c"}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:01.933894 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-53020e45-b498-4f5c-a9b1-532fc18ba861 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:01.943440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-53020e45-b498-4f5c-a9b1-532fc18ba861 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:01.944314 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-53020e45-b498-4f5c-a9b1-532fc18ba861 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:01.945635 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-53020e45-b498-4f5c-a9b1-532fc18ba861 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:01.946396 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-53020e45-b498-4f5c-a9b1-532fc18ba861 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:01.947186 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-68197fcc-472a-485c-99dc-a45df64eb217 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:01.948012 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-68197fcc-472a-485c-99dc-a45df64eb217 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:01.954821 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-68197fcc-472a-485c-99dc-a45df64eb217 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:01.955284 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-68197fcc-472a-485c-99dc-a45df64eb217 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:01.956100 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-68197fcc-472a-485c-99dc-a45df64eb217 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:01.956574 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-68197fcc-472a-485c-99dc-a45df64eb217 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:02.053740 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-53020e45-b498-4f5c-a9b1-532fc18ba861 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Invalid volume: volume 65fc12ea-eb12-4dee-bf90-2ccff6640c7c is already attached to instances: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 Jul 26 12:55:02.057152 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-68197fcc-472a-485c-99dc-a45df64eb217 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-53020e45-b498-4f5c-a9b1-532fc18ba861 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: POST /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b/os-volume_attachments HTTP/1.1 Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 74 Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:55:02.059533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:55:02.060989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:55:02.060989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:55:02.060989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:55:02.060989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:55:02.060989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:55:02.060989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:55:02.060989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:55:02.060989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:55:02.060989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:55:02.060989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Jul 26 12:55:02.060989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {"volumeAttachment": {"volumeId": "65fc12ea-eb12-4dee-bf90-2ccff6640c7c"}} Jul 26 12:55:02.060989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Invalid volume: volume 65fc12ea-eb12-4dee-bf90-2ccff6640c7c is already attached to instances: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'server_id': 'fa1010ce-5874-41a9-900d-cb5355c11d1b', 'body': {'volumeAttachment': {'volumeId': '65fc12ea-eb12-4dee-bf90-2ccff6640c7c'}}} Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 65fc12ea-eb12-4dee-bf90-2ccff6640c7c is already attached to instances: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:02.061825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 65fc12ea-eb12-4dee-bf90-2ccff6640c7c is already attached to instances: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:02.063261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:55:02.064682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:55:02.064682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:55:02.064682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:55:02.064682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 65fc12ea-eb12-4dee-bf90-2ccff6640c7c is already attached to instances: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 Jul 26 12:55:02.064682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:02.064682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-53020e45-b498-4f5c-a9b1-532fc18ba861 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 400 to user: Invalid volume: volume 65fc12ea-eb12-4dee-bf90-2ccff6640c7c is already attached to instances: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:55:02.064682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-53020e45-b498-4f5c-a9b1-532fc18ba861 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "POST /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.138590 Jul 26 12:55:02.065465 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 219/442] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 12:55:01 2022] POST /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b/os-volume_attachments => generated 174 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 12:55:02.075854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-a196de6b-9d4d-4e0e-af26-4fbd19599fe2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:02.076684 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-a196de6b-9d4d-4e0e-af26-4fbd19599fe2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:02.085578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a196de6b-9d4d-4e0e-af26-4fbd19599fe2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:02.086378 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a196de6b-9d4d-4e0e-af26-4fbd19599fe2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:02.087719 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a196de6b-9d4d-4e0e-af26-4fbd19599fe2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:02.088625 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a196de6b-9d4d-4e0e-af26-4fbd19599fe2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:02.090045 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-68197fcc-472a-485c-99dc-a45df64eb217 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1193 microversion: 2.1 time: 0.146909 Jul 26 12:55:02.090619 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 224/443] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:01 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1193 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:02.131258 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-a196de6b-9d4d-4e0e-af26-4fbd19599fe2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Going to try to terminate instance {{(pid=129307) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:55:02.258773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-a196de6b-9d4d-4e0e-af26-4fbd19599fe2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 204 len: 0 microversion: 2.1 time: 0.187376 Jul 26 12:55:02.259679 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 220/444] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:55:02 2022] DELETE /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:55:02.273364 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-56344760-3c9a-4639-b36a-2a3c31f154cb tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:02.274991 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-56344760-3c9a-4639-b36a-2a3c31f154cb tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:02.277034 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-93390674-ab0c-4cb0-84e0-abd6900d22b1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:02.277754 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-93390674-ab0c-4cb0-84e0-abd6900d22b1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:02.278738 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:02.286133 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-93390674-ab0c-4cb0-84e0-abd6900d22b1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:02.286580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-93390674-ab0c-4cb0-84e0-abd6900d22b1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:02.287759 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-93390674-ab0c-4cb0-84e0-abd6900d22b1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:02.289345 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-93390674-ab0c-4cb0-84e0-abd6900d22b1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:02.290115 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-56344760-3c9a-4639-b36a-2a3c31f154cb tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:02.291052 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-56344760-3c9a-4639-b36a-2a3c31f154cb tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:02.292891 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-56344760-3c9a-4639-b36a-2a3c31f154cb tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:02.293761 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-56344760-3c9a-4639-b36a-2a3c31f154cb tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:02.444839 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-93390674-ab0c-4cb0-84e0-abd6900d22b1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:02.454127 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-93390674-ab0c-4cb0-84e0-abd6900d22b1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:02.455779 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-93390674-ab0c-4cb0-84e0-abd6900d22b1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:02.457578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-93390674-ab0c-4cb0-84e0-abd6900d22b1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.185688 Jul 26 12:55:02.458228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 221/445] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:02 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:55:02.463026 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ced7363f-3c5a-43d9-a5bc-5f05bfe73ab8 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:02.463752 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ced7363f-3c5a-43d9-a5bc-5f05bfe73ab8 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:02.469935 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ced7363f-3c5a-43d9-a5bc-5f05bfe73ab8 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:02.470482 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ced7363f-3c5a-43d9-a5bc-5f05bfe73ab8 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:02.471319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ced7363f-3c5a-43d9-a5bc-5f05bfe73ab8 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:02.471871 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ced7363f-3c5a-43d9-a5bc-5f05bfe73ab8 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:02.537446 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ced7363f-3c5a-43d9-a5bc-5f05bfe73ab8 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:02.545351 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ced7363f-3c5a-43d9-a5bc-5f05bfe73ab8 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1276 microversion: 2.1 time: 0.085976 Jul 26 12:55:02.546097 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 222/446] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:02 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:02.622825 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-56344760-3c9a-4639-b36a-2a3c31f154cb tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:02.632409 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-56344760-3c9a-4639-b36a-2a3c31f154cb tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1682 microversion: 2.1 time: 0.368044 Jul 26 12:55:02.633060 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 225/447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:02 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1682 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:02.719229 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-001323a4-d68f-45fa-84f5-927aad624cfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:02.719880 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-001323a4-d68f-45fa-84f5-927aad624cfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:02.726160 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-001323a4-d68f-45fa-84f5-927aad624cfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:02.726653 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-001323a4-d68f-45fa-84f5-927aad624cfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:02.727441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-001323a4-d68f-45fa-84f5-927aad624cfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:02.727917 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-001323a4-d68f-45fa-84f5-927aad624cfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:02.798046 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-001323a4-d68f-45fa-84f5-927aad624cfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:02.805847 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-001323a4-d68f-45fa-84f5-927aad624cfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1139 microversion: 2.1 time: 0.090993 Jul 26 12:55:02.806418 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 223/448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:02 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:03.112255 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6eaf92ee-e396-4f98-afa5-3514db0123de tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:03.113489 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6eaf92ee-e396-4f98-afa5-3514db0123de tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:03.120001 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6eaf92ee-e396-4f98-afa5-3514db0123de tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:03.120448 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6eaf92ee-e396-4f98-afa5-3514db0123de tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:03.121210 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6eaf92ee-e396-4f98-afa5-3514db0123de tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:03.121639 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6eaf92ee-e396-4f98-afa5-3514db0123de tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:03.184055 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6eaf92ee-e396-4f98-afa5-3514db0123de tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:03.192457 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6eaf92ee-e396-4f98-afa5-3514db0123de tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1201 microversion: 2.1 time: 0.084076 Jul 26 12:55:03.193162 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 226/449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:03 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1201 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:03.487413 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-05726bcd-e0e7-41d4-abf9-1f38d02626f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:03.489372 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-05726bcd-e0e7-41d4-abf9-1f38d02626f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:03.509999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-05726bcd-e0e7-41d4-abf9-1f38d02626f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:03.510468 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-05726bcd-e0e7-41d4-abf9-1f38d02626f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:03.513019 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-05726bcd-e0e7-41d4-abf9-1f38d02626f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:03.513489 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-05726bcd-e0e7-41d4-abf9-1f38d02626f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:03.569843 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b7533474-4338-4370-b41a-7075584a2e3c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:03.570687 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b7533474-4338-4370-b41a-7075584a2e3c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:03.581982 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b7533474-4338-4370-b41a-7075584a2e3c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:03.583460 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b7533474-4338-4370-b41a-7075584a2e3c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:03.584570 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b7533474-4338-4370-b41a-7075584a2e3c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:03.585108 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b7533474-4338-4370-b41a-7075584a2e3c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:03.824628 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-05726bcd-e0e7-41d4-abf9-1f38d02626f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:03.837815 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-05726bcd-e0e7-41d4-abf9-1f38d02626f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:03.841389 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-05726bcd-e0e7-41d4-abf9-1f38d02626f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:03.842833 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-05726bcd-e0e7-41d4-abf9-1f38d02626f2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.359629 Jul 26 12:55:03.847906 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-b7533474-4338-4370-b41a-7075584a2e3c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:03.857776 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b7533474-4338-4370-b41a-7075584a2e3c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1318 microversion: 2.1 time: 0.294524 Jul 26 12:55:03.858035 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 224/450] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:03 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:55:03.871197 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-0aa32d5d-2326-4052-8637-ff16dc793e8f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:03.871197 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-0aa32d5d-2326-4052-8637-ff16dc793e8f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:03.872206 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0aa32d5d-2326-4052-8637-ff16dc793e8f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:03.872600 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 227/451] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:03 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:03.872724 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0aa32d5d-2326-4052-8637-ff16dc793e8f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:03.873454 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0aa32d5d-2326-4052-8637-ff16dc793e8f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:03.873897 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0aa32d5d-2326-4052-8637-ff16dc793e8f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:03.878677 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-15e24a22-9031-40c7-98c3-81c8517ae7c4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:03.879356 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-15e24a22-9031-40c7-98c3-81c8517ae7c4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:03.886907 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-15e24a22-9031-40c7-98c3-81c8517ae7c4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:03.887359 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-15e24a22-9031-40c7-98c3-81c8517ae7c4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:03.888243 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-15e24a22-9031-40c7-98c3-81c8517ae7c4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:03.888678 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-15e24a22-9031-40c7-98c3-81c8517ae7c4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:03.891334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:03.969511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-15e24a22-9031-40c7-98c3-81c8517ae7c4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:03.979689 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-15e24a22-9031-40c7-98c3-81c8517ae7c4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1187 microversion: 2.1 time: 0.105470 Jul 26 12:55:03.980770 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 228/452] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:03 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1187 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:04.115179 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-0aa32d5d-2326-4052-8637-ff16dc793e8f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:04.123000 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-0aa32d5d-2326-4052-8637-ff16dc793e8f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1682 microversion: 2.1 time: 0.263780 Jul 26 12:55:04.123695 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 225/453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:03 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1682 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:04.217869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-57c80b1f-98a6-4fcf-a456-94e72ebd4d80 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:04.218536 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-57c80b1f-98a6-4fcf-a456-94e72ebd4d80 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:04.228392 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-57c80b1f-98a6-4fcf-a456-94e72ebd4d80 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:04.229124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-57c80b1f-98a6-4fcf-a456-94e72ebd4d80 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:04.230288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-57c80b1f-98a6-4fcf-a456-94e72ebd4d80 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:04.230744 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-57c80b1f-98a6-4fcf-a456-94e72ebd4d80 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:04.358714 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-57c80b1f-98a6-4fcf-a456-94e72ebd4d80 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:04.370566 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-57c80b1f-98a6-4fcf-a456-94e72ebd4d80 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1211 microversion: 2.1 time: 0.159800 Jul 26 12:55:04.385109 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 229/454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:04 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1211 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:04.385348 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-59a62b0a-5bb0-4c21-9fe8-692f079a3a3c req-02c6418a-af52-4095-b1c1-8bc028ccdc98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e95a1b5c-fb80-4cfd-b51e-ae3692d25794", "tag": "0de30c07-1b45-4b27-a4af-035abd1eefd3"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:04.393180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-59a62b0a-5bb0-4c21-9fe8-692f079a3a3c req-02c6418a-af52-4095-b1c1-8bc028ccdc98 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:04.393802 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-59a62b0a-5bb0-4c21-9fe8-692f079a3a3c req-02c6418a-af52-4095-b1c1-8bc028ccdc98 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:04.407186 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-59a62b0a-5bb0-4c21-9fe8-692f079a3a3c req-02c6418a-af52-4095-b1c1-8bc028ccdc98 service nova] Creating event network-changed:0de30c07-1b45-4b27-a4af-035abd1eefd3 for instance e95a1b5c-fb80-4cfd-b51e-ae3692d25794 on hv-cinder-85093 Jul 26 12:55:04.414952 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-59a62b0a-5bb0-4c21-9fe8-692f079a3a3c req-02c6418a-af52-4095-b1c1-8bc028ccdc98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035409 Jul 26 12:55:04.415573 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 226/455] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:55:04.867352 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0047f055-c73c-4eaf-874f-698aad99bcf9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:04.868009 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0047f055-c73c-4eaf-874f-698aad99bcf9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:04.881343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0047f055-c73c-4eaf-874f-698aad99bcf9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:04.881789 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0047f055-c73c-4eaf-874f-698aad99bcf9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:04.882566 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0047f055-c73c-4eaf-874f-698aad99bcf9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:04.882995 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0047f055-c73c-4eaf-874f-698aad99bcf9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:04.888861 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-37e76d21-3193-40ab-a6ac-76335b0b934c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:04.890366 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-37e76d21-3193-40ab-a6ac-76335b0b934c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:04.899268 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-37e76d21-3193-40ab-a6ac-76335b0b934c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:04.899749 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-37e76d21-3193-40ab-a6ac-76335b0b934c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:04.901437 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-37e76d21-3193-40ab-a6ac-76335b0b934c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:04.901887 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-37e76d21-3193-40ab-a6ac-76335b0b934c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:05.204183 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0047f055-c73c-4eaf-874f-698aad99bcf9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:05.214814 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0047f055-c73c-4eaf-874f-698aad99bcf9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:05.216687 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0047f055-c73c-4eaf-874f-698aad99bcf9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:05.218089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0047f055-c73c-4eaf-874f-698aad99bcf9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.354604 Jul 26 12:55:05.218878 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 230/456] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:04 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:55:05.224621 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-80887a22-f52b-452d-8872-b2b22bf66ca3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:05.225254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-80887a22-f52b-452d-8872-b2b22bf66ca3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:05.240007 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-80887a22-f52b-452d-8872-b2b22bf66ca3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:05.240747 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-80887a22-f52b-452d-8872-b2b22bf66ca3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:05.242314 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-80887a22-f52b-452d-8872-b2b22bf66ca3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:05.242932 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-80887a22-f52b-452d-8872-b2b22bf66ca3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:05.329508 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-37e76d21-3193-40ab-a6ac-76335b0b934c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:05.339335 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-37e76d21-3193-40ab-a6ac-76335b0b934c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1318 microversion: 2.1 time: 0.464343 Jul 26 12:55:05.341700 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 227/457] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:04 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:05.343085 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-80887a22-f52b-452d-8872-b2b22bf66ca3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:05.354803 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-80887a22-f52b-452d-8872-b2b22bf66ca3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1205 microversion: 2.1 time: 0.134486 Jul 26 12:55:05.355256 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6a5f1a9e-5764-48a3-a2f8-348a812d9cc2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:05.356096 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-6a5f1a9e-5764-48a3-a2f8-348a812d9cc2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:05.356463 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 231/458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:05 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1205 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:05.362442 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:05.367622 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6a5f1a9e-5764-48a3-a2f8-348a812d9cc2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:05.368384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6a5f1a9e-5764-48a3-a2f8-348a812d9cc2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:05.369761 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6a5f1a9e-5764-48a3-a2f8-348a812d9cc2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:05.371294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6a5f1a9e-5764-48a3-a2f8-348a812d9cc2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:05.393558 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7d67b8b6-3ec7-45f7-bddf-d81a7c44975f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:05.394626 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7d67b8b6-3ec7-45f7-bddf-d81a7c44975f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:05.405731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d67b8b6-3ec7-45f7-bddf-d81a7c44975f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:05.406316 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d67b8b6-3ec7-45f7-bddf-d81a7c44975f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:05.408211 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d67b8b6-3ec7-45f7-bddf-d81a7c44975f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:05.408786 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d67b8b6-3ec7-45f7-bddf-d81a7c44975f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:05.442591 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:05.632676 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-6a5f1a9e-5764-48a3-a2f8-348a812d9cc2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:05.643542 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-6a5f1a9e-5764-48a3-a2f8-348a812d9cc2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1682 microversion: 2.1 time: 0.300612 Jul 26 12:55:05.644484 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 228/459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:05 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1682 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:05.675148 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7d67b8b6-3ec7-45f7-bddf-d81a7c44975f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:05.684087 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7d67b8b6-3ec7-45f7-bddf-d81a7c44975f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1279 microversion: 2.1 time: 0.295268 Jul 26 12:55:05.684828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 232/460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:05 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1279 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:05.908072 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-41cb44f9-986f-4b89-83a7-7f7f47bd587e req-1bed365c-7d02-402a-91d5-4595bef1d455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa1010ce-5874-41a9-900d-cb5355c11d1b", "name": "network-vif-deleted", "tag": "bcfd2cdd-0eb0-4f90-9350-81a2f6098d4e"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:05.927740 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-41cb44f9-986f-4b89-83a7-7f7f47bd587e req-1bed365c-7d02-402a-91d5-4595bef1d455 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:05.928191 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-41cb44f9-986f-4b89-83a7-7f7f47bd587e req-1bed365c-7d02-402a-91d5-4595bef1d455 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:05.941538 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-41cb44f9-986f-4b89-83a7-7f7f47bd587e req-1bed365c-7d02-402a-91d5-4595bef1d455 service nova] Creating event network-vif-deleted:bcfd2cdd-0eb0-4f90-9350-81a2f6098d4e for instance fa1010ce-5874-41a9-900d-cb5355c11d1b on hv-cinder-85093 Jul 26 12:55:05.946525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-41cb44f9-986f-4b89-83a7-7f7f47bd587e req-1bed365c-7d02-402a-91d5-4595bef1d455 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055244 Jul 26 12:55:05.947129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 229/461] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:55:06.242173 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0a75071e-dda5-4918-adb5-00623c22bd87 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:06.243748 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0a75071e-dda5-4918-adb5-00623c22bd87 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:06.256753 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0a75071e-dda5-4918-adb5-00623c22bd87 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:06.257622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0a75071e-dda5-4918-adb5-00623c22bd87 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:06.261215 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0a75071e-dda5-4918-adb5-00623c22bd87 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:06.261952 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0a75071e-dda5-4918-adb5-00623c22bd87 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:06.369774 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ba0849b7-7be9-449a-8dcf-d83256040f44 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:06.371101 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ba0849b7-7be9-449a-8dcf-d83256040f44 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:06.384043 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ba0849b7-7be9-449a-8dcf-d83256040f44 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:06.384872 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ba0849b7-7be9-449a-8dcf-d83256040f44 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:06.385869 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ba0849b7-7be9-449a-8dcf-d83256040f44 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:06.386519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ba0849b7-7be9-449a-8dcf-d83256040f44 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:06.519461 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0a75071e-dda5-4918-adb5-00623c22bd87 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:06.532713 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0a75071e-dda5-4918-adb5-00623c22bd87 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:06.536777 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0a75071e-dda5-4918-adb5-00623c22bd87 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:06.539180 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0a75071e-dda5-4918-adb5-00623c22bd87 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.300819 Jul 26 12:55:06.540819 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 233/462] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:06 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:55:06.547572 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-bf994b00-3cfd-4e71-a739-501f8c787302 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:06.551352 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-bf994b00-3cfd-4e71-a739-501f8c787302 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:06.559165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bf994b00-3cfd-4e71-a739-501f8c787302 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:06.560054 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bf994b00-3cfd-4e71-a739-501f8c787302 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:06.561455 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bf994b00-3cfd-4e71-a739-501f8c787302 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:06.562243 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bf994b00-3cfd-4e71-a739-501f8c787302 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:06.681576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ba0849b7-7be9-449a-8dcf-d83256040f44 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:06.692843 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ba0849b7-7be9-449a-8dcf-d83256040f44 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1318 microversion: 2.1 time: 0.332824 Jul 26 12:55:06.695229 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 230/463] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:06 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:06.720751 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5534f13a-355a-4696-b1bf-017cbf4f70de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:06.724477 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5534f13a-355a-4696-b1bf-017cbf4f70de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:06.736969 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5534f13a-355a-4696-b1bf-017cbf4f70de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:06.738211 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5534f13a-355a-4696-b1bf-017cbf4f70de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:06.739538 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5534f13a-355a-4696-b1bf-017cbf4f70de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:06.740380 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5534f13a-355a-4696-b1bf-017cbf4f70de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:06.785373 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5534f13a-355a-4696-b1bf-017cbf4f70de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:06.786592 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5534f13a-355a-4696-b1bf-017cbf4f70de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:06.787668 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-5534f13a-355a-4696-b1bf-017cbf4f70de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lazy-loading 'fault' on Instance uuid fa1010ce-5874-41a9-900d-cb5355c11d1b {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:55:06.994346 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5534f13a-355a-4696-b1bf-017cbf4f70de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:07.006355 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5534f13a-355a-4696-b1bf-017cbf4f70de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 200 len: 1331 microversion: 2.1 time: 0.309323 Jul 26 12:55:07.010570 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 231/464] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:06 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 1331 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:07.040124 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-36d2c71f-4329-4a69-a0b2-2beaf1266739 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:07.041130 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-36d2c71f-4329-4a69-a0b2-2beaf1266739 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:07.058030 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-36d2c71f-4329-4a69-a0b2-2beaf1266739 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:07.058893 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-36d2c71f-4329-4a69-a0b2-2beaf1266739 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:07.061238 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-36d2c71f-4329-4a69-a0b2-2beaf1266739 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:07.065183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-36d2c71f-4329-4a69-a0b2-2beaf1266739 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:07.086860 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-bf994b00-3cfd-4e71-a739-501f8c787302 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:07.103974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-bf994b00-3cfd-4e71-a739-501f8c787302 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1273 microversion: 2.1 time: 0.559200 Jul 26 12:55:07.104880 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 234/465] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:06 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1273 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:07.435592 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-420e4c86-7631-4d74-9915-dacc069edf5e req-1cf5ffe4-8fa7-480c-8d53-358eadea312a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1331709-485e-470a-9dcb-0b8832524597", "tag": "b9c4967a-1f5b-4bc9-9c07-7d4a8cc5768f"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:07.454471 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-420e4c86-7631-4d74-9915-dacc069edf5e req-1cf5ffe4-8fa7-480c-8d53-358eadea312a service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:07.455693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-420e4c86-7631-4d74-9915-dacc069edf5e req-1cf5ffe4-8fa7-480c-8d53-358eadea312a service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:07.470403 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-36d2c71f-4329-4a69-a0b2-2beaf1266739 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:07.482290 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-420e4c86-7631-4d74-9915-dacc069edf5e req-1cf5ffe4-8fa7-480c-8d53-358eadea312a service nova] Creating event network-changed:b9c4967a-1f5b-4bc9-9c07-7d4a8cc5768f for instance f1331709-485e-470a-9dcb-0b8832524597 on hv-cinder-85093 Jul 26 12:55:07.490618 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-36d2c71f-4329-4a69-a0b2-2beaf1266739 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1279 microversion: 2.1 time: 0.477637 Jul 26 12:55:07.493554 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 232/466] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:07 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1279 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:07.495408 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-420e4c86-7631-4d74-9915-dacc069edf5e req-1cf5ffe4-8fa7-480c-8d53-358eadea312a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064252 Jul 26 12:55:07.505382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 235/467] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:55:07.572070 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e697ba28-329d-45bf-9f87-c52c3a7072a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:07.573244 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e697ba28-329d-45bf-9f87-c52c3a7072a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:07.582662 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e697ba28-329d-45bf-9f87-c52c3a7072a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:07.583459 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e697ba28-329d-45bf-9f87-c52c3a7072a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:07.584409 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e697ba28-329d-45bf-9f87-c52c3a7072a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:07.584956 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e697ba28-329d-45bf-9f87-c52c3a7072a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:07.715335 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-adccf10e-6525-43f1-a4db-26f92e209f93 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:07.716618 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-adccf10e-6525-43f1-a4db-26f92e209f93 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:07.758093 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-adccf10e-6525-43f1-a4db-26f92e209f93 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:07.758817 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-adccf10e-6525-43f1-a4db-26f92e209f93 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:07.776862 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-adccf10e-6525-43f1-a4db-26f92e209f93 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:07.777324 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-adccf10e-6525-43f1-a4db-26f92e209f93 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:08.116347 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e697ba28-329d-45bf-9f87-c52c3a7072a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:08.127877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e697ba28-329d-45bf-9f87-c52c3a7072a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:08.130925 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e697ba28-329d-45bf-9f87-c52c3a7072a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:08.132233 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-adccf10e-6525-43f1-a4db-26f92e209f93 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:08.132812 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e697ba28-329d-45bf-9f87-c52c3a7072a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.567137 Jul 26 12:55:08.133458 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 233/468] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:07 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:55:08.147863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-adccf10e-6525-43f1-a4db-26f92e209f93 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1318 microversion: 2.1 time: 0.430522 Jul 26 12:55:08.147863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 236/469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:07 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:08.147863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-f2fa8dc3-9905-42e3-8cab-626c704aee52 req-4993ac2b-2c04-4a4f-b936-f670a2491ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d9b3cf-bdc1-4718-83b8-f0136bfa33c6", "tag": "030b2999-9a99-45a6-b101-7ab33c5916a7"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:08.153705 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-25a7bb9c-1fbb-4426-ab59-06effba395d2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:08.156321 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-25a7bb9c-1fbb-4426-ab59-06effba395d2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:08.160878 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-f2fa8dc3-9905-42e3-8cab-626c704aee52 req-4993ac2b-2c04-4a4f-b936-f670a2491ba7 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:08.161556 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-f2fa8dc3-9905-42e3-8cab-626c704aee52 req-4993ac2b-2c04-4a4f-b936-f670a2491ba7 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:08.172264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-25a7bb9c-1fbb-4426-ab59-06effba395d2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:08.172716 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-25a7bb9c-1fbb-4426-ab59-06effba395d2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:08.173600 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-25a7bb9c-1fbb-4426-ab59-06effba395d2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:08.174131 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-25a7bb9c-1fbb-4426-ab59-06effba395d2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:08.174654 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-f2fa8dc3-9905-42e3-8cab-626c704aee52 req-4993ac2b-2c04-4a4f-b936-f670a2491ba7 service nova] Creating event network-changed:030b2999-9a99-45a6-b101-7ab33c5916a7 for instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 on hv-cinder-85093 Jul 26 12:55:08.195820 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-f2fa8dc3-9905-42e3-8cab-626c704aee52 req-4993ac2b-2c04-4a4f-b936-f670a2491ba7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051765 Jul 26 12:55:08.197279 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 237/470] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:55:08.206108 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-cd9fccf6-91ff-4dd4-bc97-00badd49622f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:08.207823 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-cd9fccf6-91ff-4dd4-bc97-00badd49622f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:08.214184 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-25a7bb9c-1fbb-4426-ab59-06effba395d2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-25a7bb9c-1fbb-4426-ab59-06effba395d2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b HTTP/1.1 Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:55:08.215996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:55:08.217294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:55:08.217294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:55:08.217294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:55:08.217294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:55:08.217294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:55:08.217294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:55:08.217294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:55:08.217294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:55:08.217294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:55:08.217294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:55:08.217294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:55:08.217294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': 'fa1010ce-5874-41a9-900d-cb5355c11d1b'} Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:55:08.218013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:55:08.220270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:08.221373 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-25a7bb9c-1fbb-4426-ab59-06effba395d2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 404 to user: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:55:08.221373 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-25a7bb9c-1fbb-4426-ab59-06effba395d2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 404 len: 111 microversion: 2.1 time: 0.067670 Jul 26 12:55:08.221373 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 234/471] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:08 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:55:08.223102 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cd9fccf6-91ff-4dd4-bc97-00badd49622f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:08.223818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cd9fccf6-91ff-4dd4-bc97-00badd49622f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:08.224881 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cd9fccf6-91ff-4dd4-bc97-00badd49622f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:08.225384 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cd9fccf6-91ff-4dd4-bc97-00badd49622f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:08.228112 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-398d6ed8-bd5a-47b9-be1c-948bfc07c53b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '.version_select at 0x7f65f535bdc0>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:08.249516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-398d6ed8-bd5a-47b9-be1c-948bfc07c53b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-990042912" status: 202 len: 0 microversion: 2.1 time: 0.025090 Jul 26 12:55:08.250253 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 235/472] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Jul 26 12:55:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-990042912 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 12:55:08.512577 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1357a4ee-bc3a-43d3-b5a5-7458153aceb7 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:08.513203 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1357a4ee-bc3a-43d3-b5a5-7458153aceb7 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:08.525626 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1357a4ee-bc3a-43d3-b5a5-7458153aceb7 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:08.526078 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1357a4ee-bc3a-43d3-b5a5-7458153aceb7 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:08.533094 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1357a4ee-bc3a-43d3-b5a5-7458153aceb7 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:08.533723 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1357a4ee-bc3a-43d3-b5a5-7458153aceb7 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:08.739287 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-cd9fccf6-91ff-4dd4-bc97-00badd49622f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:08.750713 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-cd9fccf6-91ff-4dd4-bc97-00badd49622f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1273 microversion: 2.1 time: 0.551908 Jul 26 12:55:08.754123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 238/473] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:08 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1273 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:09.034220 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1357a4ee-bc3a-43d3-b5a5-7458153aceb7 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:09.056550 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1357a4ee-bc3a-43d3-b5a5-7458153aceb7 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1279 microversion: 2.1 time: 0.548209 Jul 26 12:55:09.070281 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 236/474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:08 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1279 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:09.164794 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-bd9d3306-f738-4ba2-9b62-a7403bbfda53 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:09.166954 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-bd9d3306-f738-4ba2-9b62-a7403bbfda53 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:09.169885 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1e1bf441-4448-46aa-baa2-2610a5696515 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:09.175288 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bd9d3306-f738-4ba2-9b62-a7403bbfda53 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:09.177316 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bd9d3306-f738-4ba2-9b62-a7403bbfda53 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:09.178676 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bd9d3306-f738-4ba2-9b62-a7403bbfda53 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:09.179360 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bd9d3306-f738-4ba2-9b62-a7403bbfda53 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:09.186426 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1e1bf441-4448-46aa-baa2-2610a5696515 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:09.203232 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1e1bf441-4448-46aa-baa2-2610a5696515 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:09.203926 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1e1bf441-4448-46aa-baa2-2610a5696515 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:09.205007 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1e1bf441-4448-46aa-baa2-2610a5696515 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:09.205761 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1e1bf441-4448-46aa-baa2-2610a5696515 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:09.442731 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bd9d3306-f738-4ba2-9b62-a7403bbfda53 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:09.467046 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bd9d3306-f738-4ba2-9b62-a7403bbfda53 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:09.469012 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bd9d3306-f738-4ba2-9b62-a7403bbfda53 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:09.470414 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-bd9d3306-f738-4ba2-9b62-a7403bbfda53 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.311135 Jul 26 12:55:09.471158 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 237/475] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:09 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:55:09.581740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1e1bf441-4448-46aa-baa2-2610a5696515 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:09.582525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-84c7e93d-2827-45bd-9b6e-604345ff0b3d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:09.584899 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-84c7e93d-2827-45bd-9b6e-604345ff0b3d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:09.591219 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-84c7e93d-2827-45bd-9b6e-604345ff0b3d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:09.591937 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-84c7e93d-2827-45bd-9b6e-604345ff0b3d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:09.593039 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-84c7e93d-2827-45bd-9b6e-604345ff0b3d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:09.593366 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1e1bf441-4448-46aa-baa2-2610a5696515 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1318 microversion: 2.1 time: 0.433171 Jul 26 12:55:09.593829 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-84c7e93d-2827-45bd-9b6e-604345ff0b3d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:09.594189 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 239/476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:09 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:09.623722 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-84c7e93d-2827-45bd-9b6e-604345ff0b3d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lazy-loading 'flavor' on Instance uuid cd47bdd7-0e5c-45eb-a6fb-979300251996 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:55:09.779241 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-196ed820-e947-4f66-9948-5c54e0db1d06 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:09.780411 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-196ed820-e947-4f66-9948-5c54e0db1d06 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:09.839827 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-196ed820-e947-4f66-9948-5c54e0db1d06 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:09.841158 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-196ed820-e947-4f66-9948-5c54e0db1d06 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:09.842786 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-196ed820-e947-4f66-9948-5c54e0db1d06 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:09.844048 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-196ed820-e947-4f66-9948-5c54e0db1d06 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:09.999432 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-84c7e93d-2827-45bd-9b6e-604345ff0b3d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "POST /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/action" status: 200 len: 32 microversion: 2.1 time: 0.422615 Jul 26 12:55:10.000434 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 238/477] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 12:55:09 2022] POST /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/action => generated 32 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 12:55:10.011890 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e6f0d446-e6c4-457e-8485-e6d5de550c5d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:10.012468 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e6f0d446-e6c4-457e-8485-e6d5de550c5d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:10.021336 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e6f0d446-e6c4-457e-8485-e6d5de550c5d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:10.022814 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e6f0d446-e6c4-457e-8485-e6d5de550c5d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:10.024140 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e6f0d446-e6c4-457e-8485-e6d5de550c5d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:10.025284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e6f0d446-e6c4-457e-8485-e6d5de550c5d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:10.313087 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-196ed820-e947-4f66-9948-5c54e0db1d06 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:10.321985 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-196ed820-e947-4f66-9948-5c54e0db1d06 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1273 microversion: 2.1 time: 0.551842 Jul 26 12:55:10.335210 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 240/478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:09 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1273 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:10.340712 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0ce2642a-e58a-4e77-9dbe-c40997ffed6e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:10.341323 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0ce2642a-e58a-4e77-9dbe-c40997ffed6e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:10.348065 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0ce2642a-e58a-4e77-9dbe-c40997ffed6e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:10.348506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0ce2642a-e58a-4e77-9dbe-c40997ffed6e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:10.349466 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0ce2642a-e58a-4e77-9dbe-c40997ffed6e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:10.349905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0ce2642a-e58a-4e77-9dbe-c40997ffed6e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:10.452753 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e6f0d446-e6c4-457e-8485-e6d5de550c5d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:10.462531 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e6f0d446-e6c4-457e-8485-e6d5de550c5d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.455354 Jul 26 12:55:10.463391 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 239/479] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:10 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:10.476153 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-bd1650f4-85d5-42af-aa18-769f3c775780 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:10.477661 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-bd1650f4-85d5-42af-aa18-769f3c775780 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:10.485633 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bd1650f4-85d5-42af-aa18-769f3c775780 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:10.486529 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bd1650f4-85d5-42af-aa18-769f3c775780 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:10.487781 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bd1650f4-85d5-42af-aa18-769f3c775780 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:10.488269 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bd1650f4-85d5-42af-aa18-769f3c775780 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:10.506219 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0ce2642a-e58a-4e77-9dbe-c40997ffed6e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:10.514666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0ce2642a-e58a-4e77-9dbe-c40997ffed6e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1267 microversion: 2.1 time: 0.177794 Jul 26 12:55:10.515315 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 241/480] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:10 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:10.520909 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e99c1b6d-d68b-4135-87f0-ba03ac2a6270 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:10.521519 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e99c1b6d-d68b-4135-87f0-ba03ac2a6270 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:10.528072 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e99c1b6d-d68b-4135-87f0-ba03ac2a6270 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:10.528740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e99c1b6d-d68b-4135-87f0-ba03ac2a6270 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:10.529517 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e99c1b6d-d68b-4135-87f0-ba03ac2a6270 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:10.529958 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e99c1b6d-d68b-4135-87f0-ba03ac2a6270 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:10.618214 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=4 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:10.630724 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-bd1650f4-85d5-42af-aa18-769f3c775780 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lazy-loading 'services' on Instance uuid 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:55:10.677321 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e99c1b6d-d68b-4135-87f0-ba03ac2a6270 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:10.689500 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e99c1b6d-d68b-4135-87f0-ba03ac2a6270 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:10.692153 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e99c1b6d-d68b-4135-87f0-ba03ac2a6270 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:10.694156 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e99c1b6d-d68b-4135-87f0-ba03ac2a6270 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.177566 Jul 26 12:55:10.694716 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 242/481] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:10 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:55:10.701456 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0b01c443-0883-449c-b181-c02459936366 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:10.702169 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0b01c443-0883-449c-b181-c02459936366 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:10.711878 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0b01c443-0883-449c-b181-c02459936366 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:10.712472 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0b01c443-0883-449c-b181-c02459936366 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:10.713365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0b01c443-0883-449c-b181-c02459936366 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:10.714098 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0b01c443-0883-449c-b181-c02459936366 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:10.792358 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-bd1650f4-85d5-42af-aa18-769f3c775780 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4/os-volume_attachments/65fc12ea-eb12-4dee-bf90-2ccff6640c7c" status: 202 len: 0 microversion: 2.1 time: 0.326969 Jul 26 12:55:10.793567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 240/482] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Jul 26 12:55:10 2022] DELETE /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4/os-volume_attachments/65fc12ea-eb12-4dee-bf90-2ccff6640c7c => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:55:10.804371 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f574d5e9-8bbd-4c76-90dd-bd97a811234b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:10.806816 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f574d5e9-8bbd-4c76-90dd-bd97a811234b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:10.815217 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f574d5e9-8bbd-4c76-90dd-bd97a811234b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:10.816260 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f574d5e9-8bbd-4c76-90dd-bd97a811234b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:10.817361 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f574d5e9-8bbd-4c76-90dd-bd97a811234b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:10.817850 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f574d5e9-8bbd-4c76-90dd-bd97a811234b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:10.866038 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f574d5e9-8bbd-4c76-90dd-bd97a811234b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067314 Jul 26 12:55:10.866742 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 241/483] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:55:10 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:55:10.901602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0b01c443-0883-449c-b181-c02459936366 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:10.910216 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0b01c443-0883-449c-b181-c02459936366 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1318 microversion: 2.1 time: 0.213847 Jul 26 12:55:10.911014 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 243/484] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:10 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:11.345080 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-748905ee-6d79-4865-ac44-0cc802b714c7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:11.345911 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-748905ee-6d79-4865-ac44-0cc802b714c7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:11.354383 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-748905ee-6d79-4865-ac44-0cc802b714c7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:11.354383 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-748905ee-6d79-4865-ac44-0cc802b714c7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:11.364824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-748905ee-6d79-4865-ac44-0cc802b714c7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:11.365656 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-748905ee-6d79-4865-ac44-0cc802b714c7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:11.390877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:11.478379 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-a1c5918e-239b-4edb-bb49-2ff57a97e9e6 req-fa7f9132-34d8-4e59-b702-be3e9ada133f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95a1b5c-fb80-4cfd-b51e-ae3692d25794", "name": "network-vif-plugged", "status": "completed", "tag": "0de30c07-1b45-4b27-a4af-035abd1eefd3"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:11.484148 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:11.485244 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=8 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:11.494512 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-a1c5918e-239b-4edb-bb49-2ff57a97e9e6 req-fa7f9132-34d8-4e59-b702-be3e9ada133f service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:11.495503 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-a1c5918e-239b-4edb-bb49-2ff57a97e9e6 req-fa7f9132-34d8-4e59-b702-be3e9ada133f service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:11.514778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-a1c5918e-239b-4edb-bb49-2ff57a97e9e6 req-fa7f9132-34d8-4e59-b702-be3e9ada133f service nova] Creating event network-vif-plugged:0de30c07-1b45-4b27-a4af-035abd1eefd3 for instance e95a1b5c-fb80-4cfd-b51e-ae3692d25794 on hv-cinder-85093 Jul 26 12:55:11.521147 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-a1c5918e-239b-4edb-bb49-2ff57a97e9e6 req-fa7f9132-34d8-4e59-b702-be3e9ada133f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046499 Jul 26 12:55:11.522468 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 244/485] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:55:11.527833 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c01b3782-2e1b-4155-8f22-ebb5673e5597 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:11.528739 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c01b3782-2e1b-4155-8f22-ebb5673e5597 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:11.546743 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c01b3782-2e1b-4155-8f22-ebb5673e5597 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:11.547933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c01b3782-2e1b-4155-8f22-ebb5673e5597 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:11.551345 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c01b3782-2e1b-4155-8f22-ebb5673e5597 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:11.552174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c01b3782-2e1b-4155-8f22-ebb5673e5597 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:11.593184 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-748905ee-6d79-4865-ac44-0cc802b714c7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:11.603133 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-748905ee-6d79-4865-ac44-0cc802b714c7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1261 microversion: 2.1 time: 0.263813 Jul 26 12:55:11.604350 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 242/486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:11 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1261 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:11.624816 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1145c663-1633-4a42-b314-fea4a1b20840 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:11.625795 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1145c663-1633-4a42-b314-fea4a1b20840 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:11.633620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1145c663-1633-4a42-b314-fea4a1b20840 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:11.634027 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1145c663-1633-4a42-b314-fea4a1b20840 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:11.635194 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1145c663-1633-4a42-b314-fea4a1b20840 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:11.636120 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1145c663-1633-4a42-b314-fea4a1b20840 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:11.699232 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=16 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:11.803408 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c01b3782-2e1b-4155-8f22-ebb5673e5597 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:11.820011 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c01b3782-2e1b-4155-8f22-ebb5673e5597 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.296024 Jul 26 12:55:11.827718 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 245/487] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:11 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:11.849416 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-018b08a4-4fd0-44a5-91ba-4c0a39da02dd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:11.852369 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-018b08a4-4fd0-44a5-91ba-4c0a39da02dd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:11.876277 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-018b08a4-4fd0-44a5-91ba-4c0a39da02dd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:11.876846 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1145c663-1633-4a42-b314-fea4a1b20840 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:11.877651 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-018b08a4-4fd0-44a5-91ba-4c0a39da02dd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:11.878527 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-018b08a4-4fd0-44a5-91ba-4c0a39da02dd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:11.879790 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-018b08a4-4fd0-44a5-91ba-4c0a39da02dd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:11.891059 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1145c663-1633-4a42-b314-fea4a1b20840 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1267 microversion: 2.1 time: 0.273844 Jul 26 12:55:11.891699 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 243/488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:11 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1267 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:11.898576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-52cd88ae-2e88-43f8-b219-d67a6e030c71 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:11.901118 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-52cd88ae-2e88-43f8-b219-d67a6e030c71 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:11.921505 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-52cd88ae-2e88-43f8-b219-d67a6e030c71 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:11.922020 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-52cd88ae-2e88-43f8-b219-d67a6e030c71 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:11.923033 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-52cd88ae-2e88-43f8-b219-d67a6e030c71 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:11.923473 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-52cd88ae-2e88-43f8-b219-d67a6e030c71 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:11.983002 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-52cd88ae-2e88-43f8-b219-d67a6e030c71 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089696 Jul 26 12:55:11.988612 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 244/489] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:55:11 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 12:55:11.990288 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f3f51ee0-b0bd-4b8f-807c-b727221c5f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:11.990908 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f3f51ee0-b0bd-4b8f-807c-b727221c5f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:11.997881 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f3f51ee0-b0bd-4b8f-807c-b727221c5f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:11.998335 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f3f51ee0-b0bd-4b8f-807c-b727221c5f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:12.000247 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f3f51ee0-b0bd-4b8f-807c-b727221c5f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:12.000943 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f3f51ee0-b0bd-4b8f-807c-b727221c5f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:12.074527 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-018b08a4-4fd0-44a5-91ba-4c0a39da02dd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:12.085214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-018b08a4-4fd0-44a5-91ba-4c0a39da02dd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:12.087155 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-018b08a4-4fd0-44a5-91ba-4c0a39da02dd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:12.088491 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-018b08a4-4fd0-44a5-91ba-4c0a39da02dd tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.259477 Jul 26 12:55:12.089163 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 246/490] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:11 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:55:12.093935 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d4b9831a-e9a3-4f5f-be10-70f6af73814c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:12.094863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d4b9831a-e9a3-4f5f-be10-70f6af73814c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:12.105488 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d4b9831a-e9a3-4f5f-be10-70f6af73814c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:12.105955 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d4b9831a-e9a3-4f5f-be10-70f6af73814c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:12.106808 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d4b9831a-e9a3-4f5f-be10-70f6af73814c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:12.107307 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d4b9831a-e9a3-4f5f-be10-70f6af73814c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:12.133927 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d4b9831a-e9a3-4f5f-be10-70f6af73814c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Going to try to terminate instance {{(pid=129308) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:55:12.182767 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f3f51ee0-b0bd-4b8f-807c-b727221c5f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:12.191567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f3f51ee0-b0bd-4b8f-807c-b727221c5f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1318 microversion: 2.1 time: 0.206203 Jul 26 12:55:12.192620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 245/491] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:11 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:12.226076 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d4b9831a-e9a3-4f5f-be10-70f6af73814c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 204 len: 0 microversion: 2.1 time: 0.135420 Jul 26 12:55:12.226733 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 247/492] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:55:12 2022] DELETE /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:55:12.235549 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-69a8465e-a235-4e0f-a2c0-e16196ed344c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:12.236214 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-69a8465e-a235-4e0f-a2c0-e16196ed344c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:12.243563 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69a8465e-a235-4e0f-a2c0-e16196ed344c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:12.244195 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69a8465e-a235-4e0f-a2c0-e16196ed344c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:12.245064 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69a8465e-a235-4e0f-a2c0-e16196ed344c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:12.245504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69a8465e-a235-4e0f-a2c0-e16196ed344c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:12.386475 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-69a8465e-a235-4e0f-a2c0-e16196ed344c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:12.395956 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-69a8465e-a235-4e0f-a2c0-e16196ed344c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1683 microversion: 2.1 time: 0.164628 Jul 26 12:55:12.396545 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 246/493] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:12 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:12.631313 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-662d5759-c7ec-4ef3-9ad1-0a8b4451bd0b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:12.632024 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-662d5759-c7ec-4ef3-9ad1-0a8b4451bd0b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:12.638684 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-662d5759-c7ec-4ef3-9ad1-0a8b4451bd0b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:12.639055 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-662d5759-c7ec-4ef3-9ad1-0a8b4451bd0b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:12.639851 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-662d5759-c7ec-4ef3-9ad1-0a8b4451bd0b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:12.640287 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-662d5759-c7ec-4ef3-9ad1-0a8b4451bd0b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:12.777899 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-662d5759-c7ec-4ef3-9ad1-0a8b4451bd0b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:12.786387 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-662d5759-c7ec-4ef3-9ad1-0a8b4451bd0b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1261 microversion: 2.1 time: 0.159845 Jul 26 12:55:12.787022 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 248/494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:12 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:12.843550 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e129c41d-400e-48a6-b0a0-890641701afd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:12.844314 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e129c41d-400e-48a6-b0a0-890641701afd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:12.850697 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e129c41d-400e-48a6-b0a0-890641701afd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:12.851237 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e129c41d-400e-48a6-b0a0-890641701afd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:12.852092 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e129c41d-400e-48a6-b0a0-890641701afd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:12.852632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e129c41d-400e-48a6-b0a0-890641701afd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:12.912802 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f8678dc9-4ea4-4125-93b1-de6580f60c5b tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:12.913429 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f8678dc9-4ea4-4125-93b1-de6580f60c5b tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:12.919626 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8678dc9-4ea4-4125-93b1-de6580f60c5b tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:12.920095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8678dc9-4ea4-4125-93b1-de6580f60c5b tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:12.920858 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8678dc9-4ea4-4125-93b1-de6580f60c5b tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:12.921286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8678dc9-4ea4-4125-93b1-de6580f60c5b tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:12.936921 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:12.988863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e129c41d-400e-48a6-b0a0-890641701afd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:12.997026 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e129c41d-400e-48a6-b0a0-890641701afd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.157307 Jul 26 12:55:12.997612 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 247/495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:12 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:13.068560 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f8678dc9-4ea4-4125-93b1-de6580f60c5b tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:13.076230 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f8678dc9-4ea4-4125-93b1-de6580f60c5b tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1267 microversion: 2.1 time: 0.167410 Jul 26 12:55:13.077009 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 249/496] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:12 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:13.111310 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-dc98f5c3-f721-4da5-a16a-91e45224c925 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:13.111958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-dc98f5c3-f721-4da5-a16a-91e45224c925 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:13.118647 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc98f5c3-f721-4da5-a16a-91e45224c925 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:13.119103 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc98f5c3-f721-4da5-a16a-91e45224c925 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:13.119973 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc98f5c3-f721-4da5-a16a-91e45224c925 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:13.120456 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc98f5c3-f721-4da5-a16a-91e45224c925 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:13.212821 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f4037308-b28b-43c9-9de8-9da6756d1dc7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:13.213430 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f4037308-b28b-43c9-9de8-9da6756d1dc7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:13.219436 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f4037308-b28b-43c9-9de8-9da6756d1dc7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:13.219918 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f4037308-b28b-43c9-9de8-9da6756d1dc7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:13.220691 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f4037308-b28b-43c9-9de8-9da6756d1dc7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:13.221130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f4037308-b28b-43c9-9de8-9da6756d1dc7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:13.255492 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-dc98f5c3-f721-4da5-a16a-91e45224c925 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:13.263971 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-dc98f5c3-f721-4da5-a16a-91e45224c925 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:13.265493 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-dc98f5c3-f721-4da5-a16a-91e45224c925 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:13.266665 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-dc98f5c3-f721-4da5-a16a-91e45224c925 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.159342 Jul 26 12:55:13.267228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 248/497] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:13 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:55:13.373876 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f4037308-b28b-43c9-9de8-9da6756d1dc7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:13.381692 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f4037308-b28b-43c9-9de8-9da6756d1dc7 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1318 microversion: 2.1 time: 0.172668 Jul 26 12:55:13.382264 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 250/498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:13 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:13.417266 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-98c36ec1-5df5-4f59-99ba-cb7fd8246e0f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:13.417887 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-98c36ec1-5df5-4f59-99ba-cb7fd8246e0f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:13.424615 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-98c36ec1-5df5-4f59-99ba-cb7fd8246e0f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:13.425140 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-98c36ec1-5df5-4f59-99ba-cb7fd8246e0f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:13.426468 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-98c36ec1-5df5-4f59-99ba-cb7fd8246e0f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:13.426914 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-98c36ec1-5df5-4f59-99ba-cb7fd8246e0f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:13.548943 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-4815ff2b-6779-4051-8cbc-d61c7f2b3ed8 req-f6beeab6-341f-4fc1-8215-da7b43e6308a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20220b7e-2897-4f0c-98da-3f352aa39ec2", "name": "network-vif-plugged", "status": "completed", "tag": "32e67b58-c4c4-4a07-b551-08232595ea42"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:13.558372 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-4815ff2b-6779-4051-8cbc-d61c7f2b3ed8 req-f6beeab6-341f-4fc1-8215-da7b43e6308a service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:13.558809 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-4815ff2b-6779-4051-8cbc-d61c7f2b3ed8 req-f6beeab6-341f-4fc1-8215-da7b43e6308a service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:13.564081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-98c36ec1-5df5-4f59-99ba-cb7fd8246e0f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:13.570124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-4815ff2b-6779-4051-8cbc-d61c7f2b3ed8 req-f6beeab6-341f-4fc1-8215-da7b43e6308a service nova] Creating event network-vif-plugged:32e67b58-c4c4-4a07-b551-08232595ea42 for instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 on hv-cinder-85093 Jul 26 12:55:13.572405 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-98c36ec1-5df5-4f59-99ba-cb7fd8246e0f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1683 microversion: 2.1 time: 0.158996 Jul 26 12:55:13.572988 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 249/499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:13 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:13.577899 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-4815ff2b-6779-4051-8cbc-d61c7f2b3ed8 req-f6beeab6-341f-4fc1-8215-da7b43e6308a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 Jul 26 12:55:13.578477 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 251/500] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:55:13.807557 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d834062b-4753-4e33-bf45-26b16507d2e8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:13.808108 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d834062b-4753-4e33-bf45-26b16507d2e8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:13.814162 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d834062b-4753-4e33-bf45-26b16507d2e8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:13.814607 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d834062b-4753-4e33-bf45-26b16507d2e8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:13.815362 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d834062b-4753-4e33-bf45-26b16507d2e8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:13.816307 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d834062b-4753-4e33-bf45-26b16507d2e8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:13.946491 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d834062b-4753-4e33-bf45-26b16507d2e8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:13.954870 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d834062b-4753-4e33-bf45-26b16507d2e8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1261 microversion: 2.1 time: 0.151213 Jul 26 12:55:13.955431 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 250/501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:13 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:14.020708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1269ef85-5ee3-44ee-a3c9-9fb439e8ddcd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:14.021707 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1269ef85-5ee3-44ee-a3c9-9fb439e8ddcd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:14.027882 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1269ef85-5ee3-44ee-a3c9-9fb439e8ddcd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:14.028331 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1269ef85-5ee3-44ee-a3c9-9fb439e8ddcd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:14.029152 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1269ef85-5ee3-44ee-a3c9-9fb439e8ddcd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:14.029588 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1269ef85-5ee3-44ee-a3c9-9fb439e8ddcd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:14.101139 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-bec923f6-84b4-4b1c-9797-7e6c0834caee tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:14.101656 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-bec923f6-84b4-4b1c-9797-7e6c0834caee tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:14.107673 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bec923f6-84b4-4b1c-9797-7e6c0834caee tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:14.108116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bec923f6-84b4-4b1c-9797-7e6c0834caee tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:14.108928 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bec923f6-84b4-4b1c-9797-7e6c0834caee tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:14.109315 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bec923f6-84b4-4b1c-9797-7e6c0834caee tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:14.165007 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1269ef85-5ee3-44ee-a3c9-9fb439e8ddcd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:14.173091 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1269ef85-5ee3-44ee-a3c9-9fb439e8ddcd tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.158507 Jul 26 12:55:14.173663 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 252/502] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:14 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:14.253782 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bec923f6-84b4-4b1c-9797-7e6c0834caee tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:14.261250 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-bec923f6-84b4-4b1c-9797-7e6c0834caee tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1267 microversion: 2.1 time: 0.164046 Jul 26 12:55:14.261814 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 251/503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:14 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:14.289481 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d514462a-ab40-4af6-a195-dd88b7a70564 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:14.290085 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d514462a-ab40-4af6-a195-dd88b7a70564 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:14.296045 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d514462a-ab40-4af6-a195-dd88b7a70564 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:14.296489 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d514462a-ab40-4af6-a195-dd88b7a70564 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:14.297245 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d514462a-ab40-4af6-a195-dd88b7a70564 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:14.297678 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d514462a-ab40-4af6-a195-dd88b7a70564 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:14.402162 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-87cb0948-6a3a-45ee-87f2-474c0f5d91b1 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:14.402882 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-87cb0948-6a3a-45ee-87f2-474c0f5d91b1 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:14.409549 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-87cb0948-6a3a-45ee-87f2-474c0f5d91b1 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:14.410005 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-87cb0948-6a3a-45ee-87f2-474c0f5d91b1 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:14.410780 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-87cb0948-6a3a-45ee-87f2-474c0f5d91b1 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:14.411246 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-87cb0948-6a3a-45ee-87f2-474c0f5d91b1 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:14.437400 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d514462a-ab40-4af6-a195-dd88b7a70564 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:14.446522 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d514462a-ab40-4af6-a195-dd88b7a70564 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:14.448051 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d514462a-ab40-4af6-a195-dd88b7a70564 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:14.449211 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d514462a-ab40-4af6-a195-dd88b7a70564 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.163594 Jul 26 12:55:14.449763 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 253/504] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:14 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:55:14.543914 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-87cb0948-6a3a-45ee-87f2-474c0f5d91b1 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:14.551955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-87cb0948-6a3a-45ee-87f2-474c0f5d91b1 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1318 microversion: 2.1 time: 0.153623 Jul 26 12:55:14.552520 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 252/505] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:14 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:14.594278 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d1f97118-2a48-4137-9fb1-2430ea1c09ee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:14.594912 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d1f97118-2a48-4137-9fb1-2430ea1c09ee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:14.601433 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d1f97118-2a48-4137-9fb1-2430ea1c09ee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:14.601887 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d1f97118-2a48-4137-9fb1-2430ea1c09ee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:14.602657 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d1f97118-2a48-4137-9fb1-2430ea1c09ee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:14.603094 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d1f97118-2a48-4137-9fb1-2430ea1c09ee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:14.749773 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d1f97118-2a48-4137-9fb1-2430ea1c09ee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:14.760922 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d1f97118-2a48-4137-9fb1-2430ea1c09ee tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1683 microversion: 2.1 time: 0.170212 Jul 26 12:55:14.761749 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 254/506] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:14 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:14.976917 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2851e310-a74d-4ef8-bd6f-d64219d541f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:14.977606 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2851e310-a74d-4ef8-bd6f-d64219d541f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:14.983915 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2851e310-a74d-4ef8-bd6f-d64219d541f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:14.984366 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2851e310-a74d-4ef8-bd6f-d64219d541f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:14.985142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2851e310-a74d-4ef8-bd6f-d64219d541f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:14.985583 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2851e310-a74d-4ef8-bd6f-d64219d541f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:15.125249 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2851e310-a74d-4ef8-bd6f-d64219d541f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:15.133151 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2851e310-a74d-4ef8-bd6f-d64219d541f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1261 microversion: 2.1 time: 0.160781 Jul 26 12:55:15.133732 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 253/507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:14 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:15.194693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9b9a5c28-655d-4ac4-85b7-cf4ab413ba72 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:15.195300 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-9b9a5c28-655d-4ac4-85b7-cf4ab413ba72 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:15.202095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9b9a5c28-655d-4ac4-85b7-cf4ab413ba72 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:15.202534 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9b9a5c28-655d-4ac4-85b7-cf4ab413ba72 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:15.203285 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9b9a5c28-655d-4ac4-85b7-cf4ab413ba72 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:15.203742 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9b9a5c28-655d-4ac4-85b7-cf4ab413ba72 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:15.281716 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-716c0644-a900-412e-a1d7-c912b7a18256 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:15.282322 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-716c0644-a900-412e-a1d7-c912b7a18256 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:15.288830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-716c0644-a900-412e-a1d7-c912b7a18256 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:15.289273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-716c0644-a900-412e-a1d7-c912b7a18256 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:15.290034 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-716c0644-a900-412e-a1d7-c912b7a18256 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:15.290468 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-716c0644-a900-412e-a1d7-c912b7a18256 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:15.331135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-9b9a5c28-655d-4ac4-85b7-cf4ab413ba72 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:15.339300 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9b9a5c28-655d-4ac4-85b7-cf4ab413ba72 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.148837 Jul 26 12:55:15.340018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 255/508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:15 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:15.421312 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-716c0644-a900-412e-a1d7-c912b7a18256 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:15.429402 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-716c0644-a900-412e-a1d7-c912b7a18256 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1267 microversion: 2.1 time: 0.151464 Jul 26 12:55:15.429960 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 254/509] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:15 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:15.474093 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-19f91361-ddca-4cd9-a8cf-4dc5915165f5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:15.474742 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-19f91361-ddca-4cd9-a8cf-4dc5915165f5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:15.481001 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-19f91361-ddca-4cd9-a8cf-4dc5915165f5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:15.481382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-19f91361-ddca-4cd9-a8cf-4dc5915165f5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:15.482159 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-19f91361-ddca-4cd9-a8cf-4dc5915165f5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:15.482590 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-19f91361-ddca-4cd9-a8cf-4dc5915165f5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:15.572796 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-fb88b366-c3a3-40ac-99ff-f14783ceb231 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:15.573741 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-fb88b366-c3a3-40ac-99ff-f14783ceb231 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:15.580620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fb88b366-c3a3-40ac-99ff-f14783ceb231 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:15.581179 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fb88b366-c3a3-40ac-99ff-f14783ceb231 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:15.581998 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fb88b366-c3a3-40ac-99ff-f14783ceb231 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:15.582498 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fb88b366-c3a3-40ac-99ff-f14783ceb231 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:15.618869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-19f91361-ddca-4cd9-a8cf-4dc5915165f5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:15.628054 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-19f91361-ddca-4cd9-a8cf-4dc5915165f5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:15.629566 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-19f91361-ddca-4cd9-a8cf-4dc5915165f5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:15.630719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-19f91361-ddca-4cd9-a8cf-4dc5915165f5 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.161247 Jul 26 12:55:15.631471 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 256/510] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:15 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:55:15.783928 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0a8e7f98-f8ba-4004-978b-345c3e8b52e4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:15.785104 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0a8e7f98-f8ba-4004-978b-345c3e8b52e4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:15.791112 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0a8e7f98-f8ba-4004-978b-345c3e8b52e4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:15.791562 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0a8e7f98-f8ba-4004-978b-345c3e8b52e4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:15.792371 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0a8e7f98-f8ba-4004-978b-345c3e8b52e4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:15.792808 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0a8e7f98-f8ba-4004-978b-345c3e8b52e4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:15.813604 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-fb88b366-c3a3-40ac-99ff-f14783ceb231 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:15.821653 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-fb88b366-c3a3-40ac-99ff-f14783ceb231 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1508 microversion: 2.1 time: 0.253174 Jul 26 12:55:15.822549 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 255/511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:15 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:15.842524 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-75f5fc1f-5bae-41be-93f9-ee40482774d3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc613b9b-a0fe-45d5-9db7-996eeaa3cba2", "device": "/dev/sdb"}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:15.845503 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-75f5fc1f-5bae-41be-93f9-ee40482774d3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:15.853431 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-75f5fc1f-5bae-41be-93f9-ee40482774d3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:15.853641 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-75f5fc1f-5bae-41be-93f9-ee40482774d3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:15.854288 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-75f5fc1f-5bae-41be-93f9-ee40482774d3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:15.854729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-75f5fc1f-5bae-41be-93f9-ee40482774d3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:15.935924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0a8e7f98-f8ba-4004-978b-345c3e8b52e4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:15.944303 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0a8e7f98-f8ba-4004-978b-345c3e8b52e4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1683 microversion: 2.1 time: 0.164291 Jul 26 12:55:15.945195 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 257/512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:15 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:16.154235 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7d97be61-a290-4e04-b16b-f86a5dbce07c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:16.154832 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7d97be61-a290-4e04-b16b-f86a5dbce07c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:16.161629 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d97be61-a290-4e04-b16b-f86a5dbce07c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:16.162448 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d97be61-a290-4e04-b16b-f86a5dbce07c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:16.163264 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d97be61-a290-4e04-b16b-f86a5dbce07c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:16.163944 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d97be61-a290-4e04-b16b-f86a5dbce07c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:16.304489 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7d97be61-a290-4e04-b16b-f86a5dbce07c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:16.314085 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7d97be61-a290-4e04-b16b-f86a5dbce07c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1261 microversion: 2.1 time: 0.163662 Jul 26 12:55:16.314940 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 258/513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:16 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:16.350945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-c890f35a-50d4-4f1d-8853-ade37e8c4cf2 req-2de2ae21-0c10-4ddb-827c-b3cb2cbbeb0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4", "name": "network-vif-deleted", "tag": "edf8881f-7a20-4fbe-8846-b9ee12ada969"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:16.371338 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-c890f35a-50d4-4f1d-8853-ade37e8c4cf2 req-2de2ae21-0c10-4ddb-827c-b3cb2cbbeb0f service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:16.371883 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-c890f35a-50d4-4f1d-8853-ade37e8c4cf2 req-2de2ae21-0c10-4ddb-827c-b3cb2cbbeb0f service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:16.387200 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-c890f35a-50d4-4f1d-8853-ade37e8c4cf2 req-2de2ae21-0c10-4ddb-827c-b3cb2cbbeb0f service nova] Creating event network-vif-deleted:edf8881f-7a20-4fbe-8846-b9ee12ada969 for instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 on hv-cinder-85093 Jul 26 12:55:16.395719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-c890f35a-50d4-4f1d-8853-ade37e8c4cf2 req-2de2ae21-0c10-4ddb-827c-b3cb2cbbeb0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048541 Jul 26 12:55:16.397206 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 259/514] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:55:16.403077 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7601f22a-0561-4eae-951a-31ec6d66f2b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:16.415384 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7601f22a-0561-4eae-951a-31ec6d66f2b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:16.429651 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7601f22a-0561-4eae-951a-31ec6d66f2b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:16.430129 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7601f22a-0561-4eae-951a-31ec6d66f2b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:16.430926 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7601f22a-0561-4eae-951a-31ec6d66f2b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:16.431450 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7601f22a-0561-4eae-951a-31ec6d66f2b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:16.593524 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7601f22a-0561-4eae-951a-31ec6d66f2b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:16.602580 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7601f22a-0561-4eae-951a-31ec6d66f2b8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.204060 Jul 26 12:55:16.603523 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 260/515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:16 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:16.608162 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-165c2235-7737-42fd-8a2b-2457db9b657c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:16.608759 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-165c2235-7737-42fd-8a2b-2457db9b657c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:16.614939 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-165c2235-7737-42fd-8a2b-2457db9b657c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:16.615389 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-165c2235-7737-42fd-8a2b-2457db9b657c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:16.616351 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-165c2235-7737-42fd-8a2b-2457db9b657c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:16.616652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-165c2235-7737-42fd-8a2b-2457db9b657c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:16.746942 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-165c2235-7737-42fd-8a2b-2457db9b657c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:16.754767 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-165c2235-7737-42fd-8a2b-2457db9b657c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1267 microversion: 2.1 time: 0.150244 Jul 26 12:55:16.755332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 261/516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:16 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:16.759796 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-94f705d6-f221-44ee-acd4-cc9f1e56b5b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:16.760400 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-94f705d6-f221-44ee-acd4-cc9f1e56b5b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:16.766694 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-94f705d6-f221-44ee-acd4-cc9f1e56b5b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:16.766941 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-94f705d6-f221-44ee-acd4-cc9f1e56b5b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:16.767667 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-94f705d6-f221-44ee-acd4-cc9f1e56b5b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:16.768109 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-94f705d6-f221-44ee-acd4-cc9f1e56b5b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:16.902875 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-94f705d6-f221-44ee-acd4-cc9f1e56b5b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:16.911618 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-94f705d6-f221-44ee-acd4-cc9f1e56b5b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:16.913162 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-94f705d6-f221-44ee-acd4-cc9f1e56b5b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:16.914329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-94f705d6-f221-44ee-acd4-cc9f1e56b5b8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.158058 Jul 26 12:55:16.915078 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 262/517] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:16 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:55:16.980759 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8b4338f8-f517-44bb-8b5c-1c7f036ec2b3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:16.982208 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8b4338f8-f517-44bb-8b5c-1c7f036ec2b3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:17.006099 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8b4338f8-f517-44bb-8b5c-1c7f036ec2b3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:17.006644 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8b4338f8-f517-44bb-8b5c-1c7f036ec2b3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:17.007378 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8b4338f8-f517-44bb-8b5c-1c7f036ec2b3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:17.007840 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8b4338f8-f517-44bb-8b5c-1c7f036ec2b3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:17.095200 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8b4338f8-f517-44bb-8b5c-1c7f036ec2b3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:17.103010 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8b4338f8-f517-44bb-8b5c-1c7f036ec2b3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1327 microversion: 2.1 time: 0.138162 Jul 26 12:55:17.103794 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 263/518] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:16 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1327 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:17.335199 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9af1c80a-98d3-4641-ab9d-5f6eab57b343 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:17.335888 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-9af1c80a-98d3-4641-ab9d-5f6eab57b343 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:17.342273 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9af1c80a-98d3-4641-ab9d-5f6eab57b343 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:17.342722 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9af1c80a-98d3-4641-ab9d-5f6eab57b343 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:17.343499 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9af1c80a-98d3-4641-ab9d-5f6eab57b343 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:17.343965 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9af1c80a-98d3-4641-ab9d-5f6eab57b343 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:17.544979 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-9af1c80a-98d3-4641-ab9d-5f6eab57b343 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:17.557967 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9af1c80a-98d3-4641-ab9d-5f6eab57b343 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1261 microversion: 2.1 time: 0.226531 Jul 26 12:55:17.558538 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 264/519] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:17 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1261 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:17.608448 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-75f5fc1f-5bae-41be-93f9-ee40482774d3 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "POST /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.769400 Jul 26 12:55:17.609154 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 256/520] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 12:55:15 2022] POST /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794/os-volume_attachments => generated 194 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:55:17.623699 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-04ee5fcf-0bfe-4557-985a-a92c042cbce2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:17.624412 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-04ee5fcf-0bfe-4557-985a-a92c042cbce2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:17.632322 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-04ee5fcf-0bfe-4557-985a-a92c042cbce2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:17.632942 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-04ee5fcf-0bfe-4557-985a-a92c042cbce2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:17.634046 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-04ee5fcf-0bfe-4557-985a-a92c042cbce2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:17.634654 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-04ee5fcf-0bfe-4557-985a-a92c042cbce2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:17.776775 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f55618c7-819b-4fad-872d-2e38ba4d3529 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:17.777515 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f55618c7-819b-4fad-872d-2e38ba4d3529 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:17.778350 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-04ee5fcf-0bfe-4557-985a-a92c042cbce2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:17.784133 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f55618c7-819b-4fad-872d-2e38ba4d3529 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:17.784658 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f55618c7-819b-4fad-872d-2e38ba4d3529 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:17.785450 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f55618c7-819b-4fad-872d-2e38ba4d3529 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:17.785876 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f55618c7-819b-4fad-872d-2e38ba4d3529 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:17.787296 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-04ee5fcf-0bfe-4557-985a-a92c042cbce2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.167424 Jul 26 12:55:17.792010 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 265/521] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:17 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:17.807139 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:17.939553 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-cec6f423-cd70-447f-a7ad-da571c5fdb31 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:17.940113 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f55618c7-819b-4fad-872d-2e38ba4d3529 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:17.941354 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-cec6f423-cd70-447f-a7ad-da571c5fdb31 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:17.949743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f55618c7-819b-4fad-872d-2e38ba4d3529 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1267 microversion: 2.1 time: 0.178034 Jul 26 12:55:17.950627 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 257/522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:17 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:17.951841 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cec6f423-cd70-447f-a7ad-da571c5fdb31 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:17.952284 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cec6f423-cd70-447f-a7ad-da571c5fdb31 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:17.953058 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cec6f423-cd70-447f-a7ad-da571c5fdb31 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:17.953496 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cec6f423-cd70-447f-a7ad-da571c5fdb31 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:18.088723 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-cec6f423-cd70-447f-a7ad-da571c5fdb31 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:18.097748 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-cec6f423-cd70-447f-a7ad-da571c5fdb31 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:18.099624 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-cec6f423-cd70-447f-a7ad-da571c5fdb31 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:18.101380 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-cec6f423-cd70-447f-a7ad-da571c5fdb31 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.167755 Jul 26 12:55:18.101972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 266/523] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:17 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:55:18.124613 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4456b67e-2773-4733-8320-b8f223ad7ca4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:18.125377 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4456b67e-2773-4733-8320-b8f223ad7ca4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:18.132909 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4456b67e-2773-4733-8320-b8f223ad7ca4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:18.133489 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4456b67e-2773-4733-8320-b8f223ad7ca4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:18.134342 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4456b67e-2773-4733-8320-b8f223ad7ca4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:18.134957 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4456b67e-2773-4733-8320-b8f223ad7ca4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:18.166300 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4456b67e-2773-4733-8320-b8f223ad7ca4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:18.166893 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4456b67e-2773-4733-8320-b8f223ad7ca4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:18.167357 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-4456b67e-2773-4733-8320-b8f223ad7ca4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lazy-loading 'fault' on Instance uuid 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:55:18.213399 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4456b67e-2773-4733-8320-b8f223ad7ca4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:18.221476 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4456b67e-2773-4733-8320-b8f223ad7ca4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 200 len: 1332 microversion: 2.1 time: 0.100695 Jul 26 12:55:18.222079 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 258/524] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:18 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:18.579053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8cf24383-631a-47ec-a29c-f9959e56d6c8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:18.579624 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8cf24383-631a-47ec-a29c-f9959e56d6c8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:18.586023 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8cf24383-631a-47ec-a29c-f9959e56d6c8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:18.586464 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8cf24383-631a-47ec-a29c-f9959e56d6c8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:18.587212 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8cf24383-631a-47ec-a29c-f9959e56d6c8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:18.587661 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8cf24383-631a-47ec-a29c-f9959e56d6c8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:18.602851 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=100 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:18.723897 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8cf24383-631a-47ec-a29c-f9959e56d6c8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:18.731595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8cf24383-631a-47ec-a29c-f9959e56d6c8 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1261 microversion: 2.1 time: 0.156465 Jul 26 12:55:18.732173 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 267/525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:18 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:18.808681 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b2fc87f9-4de0-4e90-be6c-d7cca4e7023a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:18.809453 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b2fc87f9-4de0-4e90-be6c-d7cca4e7023a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:18.816358 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b2fc87f9-4de0-4e90-be6c-d7cca4e7023a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:18.816948 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b2fc87f9-4de0-4e90-be6c-d7cca4e7023a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:18.817823 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b2fc87f9-4de0-4e90-be6c-d7cca4e7023a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:18.818364 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b2fc87f9-4de0-4e90-be6c-d7cca4e7023a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:18.970751 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8812eb3a-3288-4786-850f-afb08df44d9d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:18.971702 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8812eb3a-3288-4786-850f-afb08df44d9d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:18.979883 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8812eb3a-3288-4786-850f-afb08df44d9d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:18.980458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8812eb3a-3288-4786-850f-afb08df44d9d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:18.981360 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8812eb3a-3288-4786-850f-afb08df44d9d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:18.981903 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8812eb3a-3288-4786-850f-afb08df44d9d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:19.087937 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b2fc87f9-4de0-4e90-be6c-d7cca4e7023a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:19.102892 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b2fc87f9-4de0-4e90-be6c-d7cca4e7023a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.298002 Jul 26 12:55:19.127113 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 259/526] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:18 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:19.133689 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8df1c269-3e4f-45f7-913e-45361ee7be0d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:19.134514 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8df1c269-3e4f-45f7-913e-45361ee7be0d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:19.147973 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8df1c269-3e4f-45f7-913e-45361ee7be0d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:19.148854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8df1c269-3e4f-45f7-913e-45361ee7be0d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:19.149889 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8df1c269-3e4f-45f7-913e-45361ee7be0d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:19.150594 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8df1c269-3e4f-45f7-913e-45361ee7be0d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:19.199448 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8812eb3a-3288-4786-850f-afb08df44d9d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:19.209668 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8812eb3a-3288-4786-850f-afb08df44d9d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1267 microversion: 2.1 time: 0.243042 Jul 26 12:55:19.224418 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 268/527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:18 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1267 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:19.256005 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-4e6f072c-70db-4717-a75b-620ff931a0ac tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:19.256677 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-4e6f072c-70db-4717-a75b-620ff931a0ac tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:19.263057 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4e6f072c-70db-4717-a75b-620ff931a0ac tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:19.264369 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4e6f072c-70db-4717-a75b-620ff931a0ac tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:19.266101 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4e6f072c-70db-4717-a75b-620ff931a0ac tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:19.267298 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4e6f072c-70db-4717-a75b-620ff931a0ac tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:19.286588 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-4e6f072c-70db-4717-a75b-620ff931a0ac tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-4e6f072c-70db-4717-a75b-620ff931a0ac tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 HTTP/1.1 Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:55:19.288365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:55:19.289869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:55:19.289869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:55:19.289869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:55:19.289869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:55:19.289869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:55:19.289869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:55:19.289869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:55:19.289869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:55:19.289869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:55:19.289869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:55:19.289869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:55:19.289869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4'} Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:55:19.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:55:19.292329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:55:19.294510 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-4e6f072c-70db-4717-a75b-620ff931a0ac tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 404 to user: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:55:19.294510 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-4e6f072c-70db-4717-a75b-620ff931a0ac tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 404 len: 111 microversion: 2.1 time: 0.049376 Jul 26 12:55:19.294510 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 269/528] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:19 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:55:19.299657 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-cbd5cae4-a50b-4e07-9ca4-e0ddcb06755e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '.version_select at 0x7f65f537e820>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:19.330424 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-cbd5cae4-a50b-4e07-9ca4-e0ddcb06755e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559423665" status: 202 len: 0 microversion: 2.1 time: 0.035132 Jul 26 12:55:19.347170 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 270/529] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Jul 26 12:55:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559423665 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:55:19.416551 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8df1c269-3e4f-45f7-913e-45361ee7be0d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:19.428682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8df1c269-3e4f-45f7-913e-45361ee7be0d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:19.431239 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8df1c269-3e4f-45f7-913e-45361ee7be0d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:19.433836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8df1c269-3e4f-45f7-913e-45361ee7be0d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1810 microversion: 2.20 time: 0.305420 Jul 26 12:55:19.435067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 260/530] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:19 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1810 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:55:19.752338 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ac83a979-e6ae-4c6d-bd9a-b322e94dfe52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:19.752846 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ac83a979-e6ae-4c6d-bd9a-b322e94dfe52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:19.755923 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:19.763060 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ac83a979-e6ae-4c6d-bd9a-b322e94dfe52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:19.763795 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ac83a979-e6ae-4c6d-bd9a-b322e94dfe52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:19.764684 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ac83a979-e6ae-4c6d-bd9a-b322e94dfe52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:19.765337 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ac83a979-e6ae-4c6d-bd9a-b322e94dfe52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:19.912068 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ac83a979-e6ae-4c6d-bd9a-b322e94dfe52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:19.921613 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ac83a979-e6ae-4c6d-bd9a-b322e94dfe52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1261 microversion: 2.1 time: 0.173944 Jul 26 12:55:19.922207 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 271/531] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:19 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:20.127249 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9628d033-c9b0-41b3-9496-db85a3d4e4e7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:20.128827 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9628d033-c9b0-41b3-9496-db85a3d4e4e7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:20.134759 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9628d033-c9b0-41b3-9496-db85a3d4e4e7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:20.135719 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9628d033-c9b0-41b3-9496-db85a3d4e4e7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:20.136582 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9628d033-c9b0-41b3-9496-db85a3d4e4e7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:20.137210 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9628d033-c9b0-41b3-9496-db85a3d4e4e7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:20.230449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-611c16a2-2147-4f70-ad5e-de1c615fa8ff tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:20.231328 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-611c16a2-2147-4f70-ad5e-de1c615fa8ff tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:20.237942 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-611c16a2-2147-4f70-ad5e-de1c615fa8ff tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:20.238490 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-611c16a2-2147-4f70-ad5e-de1c615fa8ff tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:20.239362 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-611c16a2-2147-4f70-ad5e-de1c615fa8ff tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:20.239900 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-611c16a2-2147-4f70-ad5e-de1c615fa8ff tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:20.387967 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-611c16a2-2147-4f70-ad5e-de1c615fa8ff tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:20.388585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9628d033-c9b0-41b3-9496-db85a3d4e4e7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:20.396922 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-611c16a2-2147-4f70-ad5e-de1c615fa8ff tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1267 microversion: 2.1 time: 0.170308 Jul 26 12:55:20.403516 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 272/532] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:20 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:20.403689 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9628d033-c9b0-41b3-9496-db85a3d4e4e7 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.275711 Jul 26 12:55:20.403689 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 261/533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:20 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:20.462609 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-64b393a1-fba6-4830-ae73-74e309cd1010 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:20.462609 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-64b393a1-fba6-4830-ae73-74e309cd1010 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:20.468345 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-64b393a1-fba6-4830-ae73-74e309cd1010 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:20.468794 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-64b393a1-fba6-4830-ae73-74e309cd1010 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:20.469563 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-64b393a1-fba6-4830-ae73-74e309cd1010 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:20.470006 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-64b393a1-fba6-4830-ae73-74e309cd1010 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:20.558152 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c0908cba-4114-4337-b2c7-aef85cfb2b54 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Action: 'create', calling method: .version_select at 0x7f65f5353af0>, body: {"keypair": {"name": "tempest-keypair-2008185422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0tFFPT1scpfXUT+hYqSlmjx8Pa3Vif9nFhw0/p0i5j0u8ZRfUoOFPO640RpT8EJmKCH8pLukFgtCBINzKg7Kgyl7pwT+zbWV6DnMP3ByH97RudKIWKIL7DFnnM3aGBxA=="}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:20.581906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-c0908cba-4114-4337-b2c7-aef85cfb2b54 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for project 01fca015df86428b9356df3f127327c2. Resources: {'key_pairs'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:55:20.589246 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-c0908cba-4114-4337-b2c7-aef85cfb2b54 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for user 1401efb776ab424e8ff4f09eac33d92f and project 01fca015df86428b9356df3f127327c2. Resources: {'key_pairs'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:55:20.629300 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c0908cba-4114-4337-b2c7-aef85cfb2b54 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075063 Jul 26 12:55:20.630692 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 262/534] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Jul 26 12:55:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:55:20.633470 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-64b393a1-fba6-4830-ae73-74e309cd1010 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:20.643017 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-64b393a1-fba6-4830-ae73-74e309cd1010 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:20.645339 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-64b393a1-fba6-4830-ae73-74e309cd1010 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:20.646122 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-64b393a1-fba6-4830-ae73-74e309cd1010 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1797 microversion: 2.20 time: 0.188378 Jul 26 12:55:20.646685 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 273/535] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:55:20 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1797 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:55:20.942848 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-dc1a49d3-4560-45b9-b369-63ea5340d26d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:20.943460 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-dc1a49d3-4560-45b9-b369-63ea5340d26d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:20.950321 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc1a49d3-4560-45b9-b369-63ea5340d26d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:20.950763 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc1a49d3-4560-45b9-b369-63ea5340d26d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:20.951746 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc1a49d3-4560-45b9-b369-63ea5340d26d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:20.952304 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc1a49d3-4560-45b9-b369-63ea5340d26d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:21.102413 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-dc1a49d3-4560-45b9-b369-63ea5340d26d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:21.110388 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-dc1a49d3-4560-45b9-b369-63ea5340d26d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1261 microversion: 2.1 time: 0.171561 Jul 26 12:55:21.110963 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 263/536] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:20 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:21.420203 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1c070c34-5651-4fb0-bd89-0a8ac73ce61f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:21.421706 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1c070c34-5651-4fb0-bd89-0a8ac73ce61f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:21.429265 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1c070c34-5651-4fb0-bd89-0a8ac73ce61f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:21.429814 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1c070c34-5651-4fb0-bd89-0a8ac73ce61f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:21.430090 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-269043a9-70b2-492f-8e93-aa81a2ac77d4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:21.430732 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-269043a9-70b2-492f-8e93-aa81a2ac77d4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:21.431016 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1c070c34-5651-4fb0-bd89-0a8ac73ce61f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:21.431693 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1c070c34-5651-4fb0-bd89-0a8ac73ce61f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:21.449942 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-269043a9-70b2-492f-8e93-aa81a2ac77d4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:21.450402 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-269043a9-70b2-492f-8e93-aa81a2ac77d4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:21.451784 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-269043a9-70b2-492f-8e93-aa81a2ac77d4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:21.452233 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-269043a9-70b2-492f-8e93-aa81a2ac77d4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:21.575099 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1c070c34-5651-4fb0-bd89-0a8ac73ce61f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:21.584015 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1c070c34-5651-4fb0-bd89-0a8ac73ce61f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.168156 Jul 26 12:55:21.584595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 264/537] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:21 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:21.681753 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-269043a9-70b2-492f-8e93-aa81a2ac77d4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:21.691428 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-cf8bf10b-554a-4c80-a032-f60ff027d105 req-2bfd5273-0b5d-4c16-8a9b-a2c9ce12b9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d9b3cf-bdc1-4718-83b8-f0136bfa33c6", "name": "network-vif-plugged", "status": "completed", "tag": "030b2999-9a99-45a6-b101-7ab33c5916a7"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:21.692177 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-269043a9-70b2-492f-8e93-aa81a2ac77d4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1267 microversion: 2.1 time: 0.275955 Jul 26 12:55:21.693334 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 274/538] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:21 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:21.703881 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-cf8bf10b-554a-4c80-a032-f60ff027d105 req-2bfd5273-0b5d-4c16-8a9b-a2c9ce12b9f8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:21.704520 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-cf8bf10b-554a-4c80-a032-f60ff027d105 req-2bfd5273-0b5d-4c16-8a9b-a2c9ce12b9f8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:21.731163 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-cf8bf10b-554a-4c80-a032-f60ff027d105 req-2bfd5273-0b5d-4c16-8a9b-a2c9ce12b9f8 service nova] Creating event network-vif-plugged:030b2999-9a99-45a6-b101-7ab33c5916a7 for instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 on hv-cinder-85093 Jul 26 12:55:21.741566 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-cf8bf10b-554a-4c80-a032-f60ff027d105 req-2bfd5273-0b5d-4c16-8a9b-a2c9ce12b9f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054838 Jul 26 12:55:21.742453 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 265/539] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:55:22.096481 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1708810095", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "923d9432-be57-465d-9c21-1d0c5b4c37d3"}], "security_groups": [{"name": "tempest-securitygroup--1359684703"}], "key_name": "tempest-keypair-2008185422", "user_data": "}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:22.131057 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d588bb2a-c916-4bf3-98b2-86816c8c8bb9 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:22.131908 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d588bb2a-c916-4bf3-98b2-86816c8c8bb9 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:22.138525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d588bb2a-c916-4bf3-98b2-86816c8c8bb9 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:22.139045 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d588bb2a-c916-4bf3-98b2-86816c8c8bb9 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:22.140001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d588bb2a-c916-4bf3-98b2-86816c8c8bb9 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:22.140522 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d588bb2a-c916-4bf3-98b2-86816c8c8bb9 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:22.202394 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.network.neutron [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] validate_networks() for [('923d9432-be57-465d-9c21-1d0c5b4c37d3', None, None, None, None, None)] {{(pid=129308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:55:22.278480 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d588bb2a-c916-4bf3-98b2-86816c8c8bb9 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:22.286893 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d588bb2a-c916-4bf3-98b2-86816c8c8bb9 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1261 microversion: 2.1 time: 0.160214 Jul 26 12:55:22.287560 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 266/540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:22 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:22.578662 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Flavor limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:55:22.579572 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Image limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:55:22.580099 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Flavor pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:55:22.580516 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Image pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:55:22.580933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:55:22.591379 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:22.591868 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:22.592674 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:22.593112 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:22.606325 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2f25d0ba-d405-4281-8dde-ff91dbb0205d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:22.607038 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2f25d0ba-d405-4281-8dde-ff91dbb0205d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:22.611751 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for project 01fca015df86428b9356df3f127327c2. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:55:22.613834 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2f25d0ba-d405-4281-8dde-ff91dbb0205d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:22.614311 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2f25d0ba-d405-4281-8dde-ff91dbb0205d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:22.615081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2f25d0ba-d405-4281-8dde-ff91dbb0205d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:22.615718 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2f25d0ba-d405-4281-8dde-ff91dbb0205d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:22.616458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for user 1401efb776ab424e8ff4f09eac33d92f and project 01fca015df86428b9356df3f127327c2. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:55:22.627979 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Going to run 1 instances... {{(pid=129308) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:55:22.630410 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:55:22.679067 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-28587a43-ef5e-44be-bd1c-24cc793c7e79 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.586753 Jul 26 12:55:22.679749 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 275/541] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:55:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 12:55:22.690685 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f47439c9-739a-4246-bf96-b2f5e45e0622 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:22.691669 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f47439c9-739a-4246-bf96-b2f5e45e0622 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:22.748160 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f47439c9-739a-4246-bf96-b2f5e45e0622 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:22.755182 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f47439c9-739a-4246-bf96-b2f5e45e0622 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1242 microversion: 2.1 time: 0.068473 Jul 26 12:55:22.755776 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 276/542] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:22 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:22.760448 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-4e4341a9-2d8d-4d27-a151-fdd0ffe2092c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:22.761042 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-4e4341a9-2d8d-4d27-a151-fdd0ffe2092c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:22.767171 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2f25d0ba-d405-4281-8dde-ff91dbb0205d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:22.769429 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4e4341a9-2d8d-4d27-a151-fdd0ffe2092c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:22.770048 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4e4341a9-2d8d-4d27-a151-fdd0ffe2092c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:22.771005 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4e4341a9-2d8d-4d27-a151-fdd0ffe2092c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:22.771769 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4e4341a9-2d8d-4d27-a151-fdd0ffe2092c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:22.776921 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2f25d0ba-d405-4281-8dde-ff91dbb0205d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.174328 Jul 26 12:55:22.777544 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 267/543] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:22 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:22.907676 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-4e4341a9-2d8d-4d27-a151-fdd0ffe2092c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:22.915330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-4e4341a9-2d8d-4d27-a151-fdd0ffe2092c tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1267 microversion: 2.1 time: 0.158418 Jul 26 12:55:22.915934 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 277/544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:22 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:23.307748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-caaa300e-a75e-4749-b759-13a2023528da tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:23.308360 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-caaa300e-a75e-4749-b759-13a2023528da tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:23.314385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-caaa300e-a75e-4749-b759-13a2023528da tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:23.314839 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-caaa300e-a75e-4749-b759-13a2023528da tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:23.316286 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-caaa300e-a75e-4749-b759-13a2023528da tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:23.316717 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-caaa300e-a75e-4749-b759-13a2023528da tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:23.458591 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-caaa300e-a75e-4749-b759-13a2023528da tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:23.466295 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-caaa300e-a75e-4749-b759-13a2023528da tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1261 microversion: 2.1 time: 0.162460 Jul 26 12:55:23.466927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 268/545] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:23 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:23.771935 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-8722d4af-c110-480e-b0fc-e8c069172d62 req-d333d518-ebe9-42d1-a35d-9c628919cd57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1331709-485e-470a-9dcb-0b8832524597", "name": "network-vif-plugged", "status": "completed", "tag": "b9c4967a-1f5b-4bc9-9c07-7d4a8cc5768f"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:23.776229 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e498bd9d-a154-49b7-9f1f-8766d6f4b799 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:23.776847 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e498bd9d-a154-49b7-9f1f-8766d6f4b799 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:23.782049 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-8722d4af-c110-480e-b0fc-e8c069172d62 req-d333d518-ebe9-42d1-a35d-9c628919cd57 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:23.782488 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-8722d4af-c110-480e-b0fc-e8c069172d62 req-d333d518-ebe9-42d1-a35d-9c628919cd57 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:23.783375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e498bd9d-a154-49b7-9f1f-8766d6f4b799 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:23.783875 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e498bd9d-a154-49b7-9f1f-8766d6f4b799 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:23.785145 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e498bd9d-a154-49b7-9f1f-8766d6f4b799 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:23.785585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e498bd9d-a154-49b7-9f1f-8766d6f4b799 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:23.794834 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-8722d4af-c110-480e-b0fc-e8c069172d62 req-d333d518-ebe9-42d1-a35d-9c628919cd57 service nova] Creating event network-vif-plugged:b9c4967a-1f5b-4bc9-9c07-7d4a8cc5768f for instance f1331709-485e-470a-9dcb-0b8832524597 on hv-cinder-85093 Jul 26 12:55:23.800547 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-8722d4af-c110-480e-b0fc-e8c069172d62 req-d333d518-ebe9-42d1-a35d-9c628919cd57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031644 Jul 26 12:55:23.801149 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 278/546] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:55:23.806116 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-989d5881-d254-4e5e-b8d8-8a999a12d04f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:23.806806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-989d5881-d254-4e5e-b8d8-8a999a12d04f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:23.812948 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-989d5881-d254-4e5e-b8d8-8a999a12d04f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:23.813393 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-989d5881-d254-4e5e-b8d8-8a999a12d04f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:23.814147 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-989d5881-d254-4e5e-b8d8-8a999a12d04f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:23.814576 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-989d5881-d254-4e5e-b8d8-8a999a12d04f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:23.850580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e498bd9d-a154-49b7-9f1f-8766d6f4b799 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:23.858015 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e498bd9d-a154-49b7-9f1f-8766d6f4b799 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1294 microversion: 2.1 time: 0.085443 Jul 26 12:55:23.858599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 269/547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:23 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:23.935426 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9b56c652-0f8a-4cd7-bf2b-82c8cb849a86 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:23.936189 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9b56c652-0f8a-4cd7-bf2b-82c8cb849a86 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:23.939205 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:23.943574 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9b56c652-0f8a-4cd7-bf2b-82c8cb849a86 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:23.944061 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9b56c652-0f8a-4cd7-bf2b-82c8cb849a86 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:23.944837 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9b56c652-0f8a-4cd7-bf2b-82c8cb849a86 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:23.945285 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9b56c652-0f8a-4cd7-bf2b-82c8cb849a86 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:23.972543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-989d5881-d254-4e5e-b8d8-8a999a12d04f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:23.980747 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-989d5881-d254-4e5e-b8d8-8a999a12d04f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.178488 Jul 26 12:55:23.981314 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 279/548] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:23 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:24.085897 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9b56c652-0f8a-4cd7-bf2b-82c8cb849a86 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:24.093585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9b56c652-0f8a-4cd7-bf2b-82c8cb849a86 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1454 microversion: 2.1 time: 0.162086 Jul 26 12:55:24.094152 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 270/549] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:23 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:24.114548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-2258bdc3-67c1-4e0c-8985-9b5eb5a18467 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:24.115153 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-2258bdc3-67c1-4e0c-8985-9b5eb5a18467 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:24.121219 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2258bdc3-67c1-4e0c-8985-9b5eb5a18467 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:24.121663 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2258bdc3-67c1-4e0c-8985-9b5eb5a18467 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:24.122444 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2258bdc3-67c1-4e0c-8985-9b5eb5a18467 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:24.122880 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2258bdc3-67c1-4e0c-8985-9b5eb5a18467 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:24.254660 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2258bdc3-67c1-4e0c-8985-9b5eb5a18467 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:24.263751 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-2258bdc3-67c1-4e0c-8985-9b5eb5a18467 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1454 microversion: 2.1 time: 0.153039 Jul 26 12:55:24.264331 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 280/550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:24 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:24.486705 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3a9a88f7-8a71-4f03-9f83-4b8195bb8003 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:24.487324 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3a9a88f7-8a71-4f03-9f83-4b8195bb8003 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:24.498597 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3a9a88f7-8a71-4f03-9f83-4b8195bb8003 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:24.499074 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3a9a88f7-8a71-4f03-9f83-4b8195bb8003 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:24.499897 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3a9a88f7-8a71-4f03-9f83-4b8195bb8003 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:24.500346 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3a9a88f7-8a71-4f03-9f83-4b8195bb8003 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:24.664799 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3a9a88f7-8a71-4f03-9f83-4b8195bb8003 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:24.672928 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3a9a88f7-8a71-4f03-9f83-4b8195bb8003 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1261 microversion: 2.1 time: 0.190067 Jul 26 12:55:24.673663 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 271/551] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:24 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:24.881356 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b12901fa-2b4d-4898-8be9-6932efb21632 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:24.882083 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b12901fa-2b4d-4898-8be9-6932efb21632 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:24.895053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b12901fa-2b4d-4898-8be9-6932efb21632 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:24.895864 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b12901fa-2b4d-4898-8be9-6932efb21632 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:24.896879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b12901fa-2b4d-4898-8be9-6932efb21632 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:24.908353 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b12901fa-2b4d-4898-8be9-6932efb21632 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:25.002333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-dd0e0220-24fd-4281-89a6-5975c22eb690 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:25.003310 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-dd0e0220-24fd-4281-89a6-5975c22eb690 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:25.006897 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-b12901fa-2b4d-4898-8be9-6932efb21632 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:25.010256 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dd0e0220-24fd-4281-89a6-5975c22eb690 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:25.010836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dd0e0220-24fd-4281-89a6-5975c22eb690 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:25.011805 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dd0e0220-24fd-4281-89a6-5975c22eb690 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:25.012349 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dd0e0220-24fd-4281-89a6-5975c22eb690 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:25.017483 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b12901fa-2b4d-4898-8be9-6932efb21632 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1312 microversion: 2.1 time: 0.139567 Jul 26 12:55:25.017483 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 281/552] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:24 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1312 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:25.156746 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-dd0e0220-24fd-4281-89a6-5975c22eb690 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:25.165659 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-dd0e0220-24fd-4281-89a6-5975c22eb690 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.167332 Jul 26 12:55:25.166239 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 272/553] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:24 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:25.695478 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5375826d-4e1d-4eb1-a284-09cf9f29dd52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:25.696323 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-5375826d-4e1d-4eb1-a284-09cf9f29dd52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:25.703165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5375826d-4e1d-4eb1-a284-09cf9f29dd52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:25.703871 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5375826d-4e1d-4eb1-a284-09cf9f29dd52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:25.704699 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5375826d-4e1d-4eb1-a284-09cf9f29dd52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:25.706080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5375826d-4e1d-4eb1-a284-09cf9f29dd52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:26.040314 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d37e16d4-7d53-4731-8006-a0c243093cb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:26.041007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d37e16d4-7d53-4731-8006-a0c243093cb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:26.048762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d37e16d4-7d53-4731-8006-a0c243093cb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:26.049309 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d37e16d4-7d53-4731-8006-a0c243093cb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:26.050179 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d37e16d4-7d53-4731-8006-a0c243093cb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:26.050764 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d37e16d4-7d53-4731-8006-a0c243093cb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:26.085169 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-5375826d-4e1d-4eb1-a284-09cf9f29dd52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:26.100655 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-5375826d-4e1d-4eb1-a284-09cf9f29dd52 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1261 microversion: 2.1 time: 0.409994 Jul 26 12:55:26.101488 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 282/554] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:25 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1261 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:26.188340 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c4fc1a31-f88d-4ab3-bb5e-e4fad3f909ee tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:26.188961 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c4fc1a31-f88d-4ab3-bb5e-e4fad3f909ee tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:26.197000 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c4fc1a31-f88d-4ab3-bb5e-e4fad3f909ee tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:26.201037 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c4fc1a31-f88d-4ab3-bb5e-e4fad3f909ee tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:26.202073 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c4fc1a31-f88d-4ab3-bb5e-e4fad3f909ee tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:26.204195 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c4fc1a31-f88d-4ab3-bb5e-e4fad3f909ee tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:26.307320 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d37e16d4-7d53-4731-8006-a0c243093cb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:26.315707 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d37e16d4-7d53-4731-8006-a0c243093cb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.278684 Jul 26 12:55:26.320381 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 273/555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:26 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:26.474586 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c4fc1a31-f88d-4ab3-bb5e-e4fad3f909ee tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:26.486963 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c4fc1a31-f88d-4ab3-bb5e-e4fad3f909ee tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.302755 Jul 26 12:55:26.495469 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 283/556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:26 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:26.552489 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-4157f213-47e3-4205-b785-6d799fe8436d req-3292d831-53ef-414e-8c84-aab96870db43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d9b3cf-bdc1-4718-83b8-f0136bfa33c6", "tag": "030b2999-9a99-45a6-b101-7ab33c5916a7"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:26.562715 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-4157f213-47e3-4205-b785-6d799fe8436d req-3292d831-53ef-414e-8c84-aab96870db43 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:26.563097 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-4157f213-47e3-4205-b785-6d799fe8436d req-3292d831-53ef-414e-8c84-aab96870db43 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:26.574675 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-4157f213-47e3-4205-b785-6d799fe8436d req-3292d831-53ef-414e-8c84-aab96870db43 service nova] Creating event network-changed:030b2999-9a99-45a6-b101-7ab33c5916a7 for instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 on hv-cinder-85093 Jul 26 12:55:26.579744 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-4157f213-47e3-4205-b785-6d799fe8436d req-3292d831-53ef-414e-8c84-aab96870db43 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031330 Jul 26 12:55:26.580351 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 274/557] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:55:27.122099 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ed4810e4-f3af-46be-87b5-8e6f50d36893 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:27.122705 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ed4810e4-f3af-46be-87b5-8e6f50d36893 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:27.131783 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed4810e4-f3af-46be-87b5-8e6f50d36893 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:27.132459 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed4810e4-f3af-46be-87b5-8e6f50d36893 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:27.133227 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed4810e4-f3af-46be-87b5-8e6f50d36893 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:27.133819 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed4810e4-f3af-46be-87b5-8e6f50d36893 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:27.298183 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ed4810e4-f3af-46be-87b5-8e6f50d36893 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:27.306909 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ed4810e4-f3af-46be-87b5-8e6f50d36893 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1444 microversion: 2.1 time: 0.188423 Jul 26 12:55:27.308063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 284/558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:27 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1444 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:27.339379 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2016175e-f12c-4917-8b8f-6c8ae3fdd13e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:27.344401 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2016175e-f12c-4917-8b8f-6c8ae3fdd13e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:27.349913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-99e6fe35-d469-4ac3-bcaf-3d06ea5b4d41 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:27.350776 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-99e6fe35-d469-4ac3-bcaf-3d06ea5b4d41 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:27.356541 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2016175e-f12c-4917-8b8f-6c8ae3fdd13e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:27.360016 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-99e6fe35-d469-4ac3-bcaf-3d06ea5b4d41 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:27.360466 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-99e6fe35-d469-4ac3-bcaf-3d06ea5b4d41 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:27.361269 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-99e6fe35-d469-4ac3-bcaf-3d06ea5b4d41 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:27.361701 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-99e6fe35-d469-4ac3-bcaf-3d06ea5b4d41 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:27.364988 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2016175e-f12c-4917-8b8f-6c8ae3fdd13e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:27.365807 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2016175e-f12c-4917-8b8f-6c8ae3fdd13e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:27.366444 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2016175e-f12c-4917-8b8f-6c8ae3fdd13e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:27.567589 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-99e6fe35-d469-4ac3-bcaf-3d06ea5b4d41 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:27.583823 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-99e6fe35-d469-4ac3-bcaf-3d06ea5b4d41 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.242944 Jul 26 12:55:27.584343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 285/559] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:27 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:27.589904 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-bd77e967-af13-450d-be32-13b93e93b1c0 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:27.590778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-bd77e967-af13-450d-be32-13b93e93b1c0 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:27.596833 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bd77e967-af13-450d-be32-13b93e93b1c0 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:27.597293 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bd77e967-af13-450d-be32-13b93e93b1c0 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:27.598092 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bd77e967-af13-450d-be32-13b93e93b1c0 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:27.598598 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bd77e967-af13-450d-be32-13b93e93b1c0 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:27.759445 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-bd77e967-af13-450d-be32-13b93e93b1c0 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:27.769306 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-bd77e967-af13-450d-be32-13b93e93b1c0 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.183625 Jul 26 12:55:27.770133 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 286/560] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:27 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:27.791209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2016175e-f12c-4917-8b8f-6c8ae3fdd13e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:27.799204 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2016175e-f12c-4917-8b8f-6c8ae3fdd13e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1444 microversion: 2.1 time: 0.463934 Jul 26 12:55:27.800120 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 275/561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:27 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1444 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:28.132612 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-0c61a5fe-8ac7-42a3-894a-bd7035588b4f req-bd6ba29b-1dcf-43c6-8a5b-844066ea4d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35776963-2d4e-4698-9ad3-b91a5be95f1c", "tag": "73ba4e0a-a6ad-4a34-9132-7824ae016df1"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:28.143994 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-0c61a5fe-8ac7-42a3-894a-bd7035588b4f req-bd6ba29b-1dcf-43c6-8a5b-844066ea4d92 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:28.145375 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-0c61a5fe-8ac7-42a3-894a-bd7035588b4f req-bd6ba29b-1dcf-43c6-8a5b-844066ea4d92 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:28.167922 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-0c61a5fe-8ac7-42a3-894a-bd7035588b4f req-bd6ba29b-1dcf-43c6-8a5b-844066ea4d92 service nova] Creating event network-changed:73ba4e0a-a6ad-4a34-9132-7824ae016df1 for instance 35776963-2d4e-4698-9ad3-b91a5be95f1c on hv-cinder-85093 Jul 26 12:55:28.174173 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-0c61a5fe-8ac7-42a3-894a-bd7035588b4f req-bd6ba29b-1dcf-43c6-8a5b-844066ea4d92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045748 Jul 26 12:55:28.174783 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 287/562] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:55:28.609071 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1be080af-b982-4189-acaf-be4ec7fd8fa1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:28.609962 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1be080af-b982-4189-acaf-be4ec7fd8fa1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:28.616563 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1be080af-b982-4189-acaf-be4ec7fd8fa1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:28.617011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1be080af-b982-4189-acaf-be4ec7fd8fa1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:28.617779 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1be080af-b982-4189-acaf-be4ec7fd8fa1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:28.618206 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1be080af-b982-4189-acaf-be4ec7fd8fa1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:28.621069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=100 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:28.750821 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1be080af-b982-4189-acaf-be4ec7fd8fa1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:28.759028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1be080af-b982-4189-acaf-be4ec7fd8fa1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.153893 Jul 26 12:55:28.759598 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 276/563] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:28 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:28.791338 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7d368780-6541-4f7f-bae0-ffdbf0d387ae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:28.792079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7d368780-6541-4f7f-bae0-ffdbf0d387ae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:28.798310 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d368780-6541-4f7f-bae0-ffdbf0d387ae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:28.799036 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d368780-6541-4f7f-bae0-ffdbf0d387ae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:28.799695 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d368780-6541-4f7f-bae0-ffdbf0d387ae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:28.800144 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d368780-6541-4f7f-bae0-ffdbf0d387ae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:29.030537 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7d368780-6541-4f7f-bae0-ffdbf0d387ae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:29.033141 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=100 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:29.041045 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7d368780-6541-4f7f-bae0-ffdbf0d387ae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.253923 Jul 26 12:55:29.041626 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 288/564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:28 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:29.635262 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-fabd9ec2-d6fe-479e-bb14-0243465cdbce req-1522cce8-9da3-442e-a6c1-ca3e130902c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1331709-485e-470a-9dcb-0b8832524597", "tag": "b9c4967a-1f5b-4bc9-9c07-7d4a8cc5768f"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:29.653043 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-fabd9ec2-d6fe-479e-bb14-0243465cdbce req-1522cce8-9da3-442e-a6c1-ca3e130902c0 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:29.653491 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-fabd9ec2-d6fe-479e-bb14-0243465cdbce req-1522cce8-9da3-442e-a6c1-ca3e130902c0 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:29.664900 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-fabd9ec2-d6fe-479e-bb14-0243465cdbce req-1522cce8-9da3-442e-a6c1-ca3e130902c0 service nova] Creating event network-changed:b9c4967a-1f5b-4bc9-9c07-7d4a8cc5768f for instance f1331709-485e-470a-9dcb-0b8832524597 on hv-cinder-85093 Jul 26 12:55:29.669695 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-fabd9ec2-d6fe-479e-bb14-0243465cdbce req-1522cce8-9da3-442e-a6c1-ca3e130902c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038189 Jul 26 12:55:29.670288 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 277/565] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:55:29.779890 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6b3e2c12-1fd5-4deb-b9d8-82e29653f1a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:29.780678 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6b3e2c12-1fd5-4deb-b9d8-82e29653f1a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:29.787557 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6b3e2c12-1fd5-4deb-b9d8-82e29653f1a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:29.788105 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6b3e2c12-1fd5-4deb-b9d8-82e29653f1a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:29.788868 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6b3e2c12-1fd5-4deb-b9d8-82e29653f1a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:29.789506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6b3e2c12-1fd5-4deb-b9d8-82e29653f1a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:29.921061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6b3e2c12-1fd5-4deb-b9d8-82e29653f1a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:29.929375 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6b3e2c12-1fd5-4deb-b9d8-82e29653f1a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.153320 Jul 26 12:55:29.932093 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 289/566] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:29 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:30.062922 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-69364c96-c586-400b-b22a-84428b66c8d2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:30.063520 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-69364c96-c586-400b-b22a-84428b66c8d2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:30.070507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69364c96-c586-400b-b22a-84428b66c8d2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:30.070955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69364c96-c586-400b-b22a-84428b66c8d2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:30.071739 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69364c96-c586-400b-b22a-84428b66c8d2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:30.072175 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-69364c96-c586-400b-b22a-84428b66c8d2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:30.204146 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-69364c96-c586-400b-b22a-84428b66c8d2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:30.212410 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-69364c96-c586-400b-b22a-84428b66c8d2 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.153713 Jul 26 12:55:30.212995 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 278/567] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:30 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:30.956574 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c362fa6e-34ce-4c59-b5e0-66a858a6f857 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:30.958343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c362fa6e-34ce-4c59-b5e0-66a858a6f857 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:30.964209 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c362fa6e-34ce-4c59-b5e0-66a858a6f857 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:30.964425 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c362fa6e-34ce-4c59-b5e0-66a858a6f857 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:30.965419 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c362fa6e-34ce-4c59-b5e0-66a858a6f857 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:30.965850 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c362fa6e-34ce-4c59-b5e0-66a858a6f857 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:31.204415 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c362fa6e-34ce-4c59-b5e0-66a858a6f857 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:31.212704 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c362fa6e-34ce-4c59-b5e0-66a858a6f857 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.259963 Jul 26 12:55:31.213544 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 290/568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:30 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:31.236155 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f186d239-1042-4dcc-bc7d-66a3aa444033 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:31.236823 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f186d239-1042-4dcc-bc7d-66a3aa444033 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:31.241567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=4 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:31.249008 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f186d239-1042-4dcc-bc7d-66a3aa444033 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:31.249623 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f186d239-1042-4dcc-bc7d-66a3aa444033 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:31.250403 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f186d239-1042-4dcc-bc7d-66a3aa444033 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:31.250835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f186d239-1042-4dcc-bc7d-66a3aa444033 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:31.471878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f186d239-1042-4dcc-bc7d-66a3aa444033 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:31.483954 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f186d239-1042-4dcc-bc7d-66a3aa444033 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.253881 Jul 26 12:55:31.484744 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 279/569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:31 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:32.240824 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-39bb3820-79d2-4816-aed8-fed516e32ec7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:32.241438 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-39bb3820-79d2-4816-aed8-fed516e32ec7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:32.248105 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-39bb3820-79d2-4816-aed8-fed516e32ec7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:32.248560 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-39bb3820-79d2-4816-aed8-fed516e32ec7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:32.249391 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-39bb3820-79d2-4816-aed8-fed516e32ec7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:32.249862 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-39bb3820-79d2-4816-aed8-fed516e32ec7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:32.382940 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-39bb3820-79d2-4816-aed8-fed516e32ec7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:32.390381 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-39bb3820-79d2-4816-aed8-fed516e32ec7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.153971 Jul 26 12:55:32.390937 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 291/570] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:32 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:32.506046 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-27d9d246-e5dd-435e-bcac-5c4a4a1f7478 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:32.507269 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-27d9d246-e5dd-435e-bcac-5c4a4a1f7478 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:32.513895 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-27d9d246-e5dd-435e-bcac-5c4a4a1f7478 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:32.514354 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-27d9d246-e5dd-435e-bcac-5c4a4a1f7478 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:32.515241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-27d9d246-e5dd-435e-bcac-5c4a4a1f7478 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:32.515734 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-27d9d246-e5dd-435e-bcac-5c4a4a1f7478 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:32.653207 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-27d9d246-e5dd-435e-bcac-5c4a4a1f7478 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:32.661607 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-27d9d246-e5dd-435e-bcac-5c4a4a1f7478 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.160265 Jul 26 12:55:32.662168 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 280/571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:32 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:33.409983 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5de410e3-3ea6-4425-a5bf-7b6f714ee1d4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:33.410593 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-5de410e3-3ea6-4425-a5bf-7b6f714ee1d4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:33.412493 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:33.413174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=8 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:33.419787 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5de410e3-3ea6-4425-a5bf-7b6f714ee1d4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:33.420314 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5de410e3-3ea6-4425-a5bf-7b6f714ee1d4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:33.421012 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5de410e3-3ea6-4425-a5bf-7b6f714ee1d4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:33.421451 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5de410e3-3ea6-4425-a5bf-7b6f714ee1d4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:33.554024 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-5de410e3-3ea6-4425-a5bf-7b6f714ee1d4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:33.562725 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-5de410e3-3ea6-4425-a5bf-7b6f714ee1d4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.156600 Jul 26 12:55:33.563283 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 292/572] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:33 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:33.682611 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b4c064e9-a431-46c8-bff3-4ea578168636 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:33.683143 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b4c064e9-a431-46c8-bff3-4ea578168636 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:33.689630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b4c064e9-a431-46c8-bff3-4ea578168636 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:33.690071 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b4c064e9-a431-46c8-bff3-4ea578168636 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:33.690824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b4c064e9-a431-46c8-bff3-4ea578168636 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:33.691267 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b4c064e9-a431-46c8-bff3-4ea578168636 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:33.818694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b4c064e9-a431-46c8-bff3-4ea578168636 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:33.826645 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b4c064e9-a431-46c8-bff3-4ea578168636 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.147924 Jul 26 12:55:33.827214 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 281/573] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:33 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:34.587384 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-286537b2-405d-4556-b2f3-ddb7394336c7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:34.588003 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-286537b2-405d-4556-b2f3-ddb7394336c7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:34.594632 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-286537b2-405d-4556-b2f3-ddb7394336c7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:34.595083 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-286537b2-405d-4556-b2f3-ddb7394336c7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:34.595896 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-286537b2-405d-4556-b2f3-ddb7394336c7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:34.596336 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-286537b2-405d-4556-b2f3-ddb7394336c7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:34.728050 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-286537b2-405d-4556-b2f3-ddb7394336c7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:34.735603 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-286537b2-405d-4556-b2f3-ddb7394336c7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.154513 Jul 26 12:55:34.736192 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 293/574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:34 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:34.848659 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b42567f0-b5c0-41d9-8696-7f1a2b08cf1b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:34.849230 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b42567f0-b5c0-41d9-8696-7f1a2b08cf1b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:34.855802 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b42567f0-b5c0-41d9-8696-7f1a2b08cf1b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:34.856260 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b42567f0-b5c0-41d9-8696-7f1a2b08cf1b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:34.857030 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b42567f0-b5c0-41d9-8696-7f1a2b08cf1b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:34.857474 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b42567f0-b5c0-41d9-8696-7f1a2b08cf1b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:34.995843 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b42567f0-b5c0-41d9-8696-7f1a2b08cf1b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:35.004454 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b42567f0-b5c0-41d9-8696-7f1a2b08cf1b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.159195 Jul 26 12:55:35.005029 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 282/575] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:34 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:35.756544 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-012a560b-1109-41e7-a3d8-2ddabe0c4422 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:35.757153 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-012a560b-1109-41e7-a3d8-2ddabe0c4422 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:35.763629 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-012a560b-1109-41e7-a3d8-2ddabe0c4422 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:35.764109 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-012a560b-1109-41e7-a3d8-2ddabe0c4422 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:35.764874 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-012a560b-1109-41e7-a3d8-2ddabe0c4422 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:35.765314 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-012a560b-1109-41e7-a3d8-2ddabe0c4422 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:35.898743 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-012a560b-1109-41e7-a3d8-2ddabe0c4422 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:35.906611 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-012a560b-1109-41e7-a3d8-2ddabe0c4422 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.153805 Jul 26 12:55:35.907469 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 294/576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:35 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:36.026465 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-06bd70e4-dace-4e78-8300-89ba2c5f6dac tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:36.027066 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-06bd70e4-dace-4e78-8300-89ba2c5f6dac tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:36.033541 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-06bd70e4-dace-4e78-8300-89ba2c5f6dac tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:36.033983 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-06bd70e4-dace-4e78-8300-89ba2c5f6dac tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:36.034729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-06bd70e4-dace-4e78-8300-89ba2c5f6dac tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:36.035822 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-06bd70e4-dace-4e78-8300-89ba2c5f6dac tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:36.165685 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-06bd70e4-dace-4e78-8300-89ba2c5f6dac tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:36.173703 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-06bd70e4-dace-4e78-8300-89ba2c5f6dac tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.151029 Jul 26 12:55:36.174275 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 283/577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:36 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:36.930102 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-11d0c546-ed97-4de7-85bf-c473935f63c1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:36.930768 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-11d0c546-ed97-4de7-85bf-c473935f63c1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:36.938006 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-11d0c546-ed97-4de7-85bf-c473935f63c1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:36.938451 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-11d0c546-ed97-4de7-85bf-c473935f63c1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:36.939223 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-11d0c546-ed97-4de7-85bf-c473935f63c1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:36.939681 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-11d0c546-ed97-4de7-85bf-c473935f63c1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:37.072820 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-11d0c546-ed97-4de7-85bf-c473935f63c1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:37.080685 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-11d0c546-ed97-4de7-85bf-c473935f63c1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.155257 Jul 26 12:55:37.081260 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 295/578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:36 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:37.194382 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-460f06b0-77e1-4ef4-8c16-9bfd1046f531 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:37.194995 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-460f06b0-77e1-4ef4-8c16-9bfd1046f531 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:37.201450 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-460f06b0-77e1-4ef4-8c16-9bfd1046f531 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:37.201908 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-460f06b0-77e1-4ef4-8c16-9bfd1046f531 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:37.202671 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-460f06b0-77e1-4ef4-8c16-9bfd1046f531 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:37.203114 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-460f06b0-77e1-4ef4-8c16-9bfd1046f531 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:37.351004 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-460f06b0-77e1-4ef4-8c16-9bfd1046f531 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:37.358990 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-460f06b0-77e1-4ef4-8c16-9bfd1046f531 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.168533 Jul 26 12:55:37.359562 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 284/579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:37 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:38.101675 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d7edbd42-ba0f-4674-be44-5ea6e2196dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:38.102289 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d7edbd42-ba0f-4674-be44-5ea6e2196dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:38.109015 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d7edbd42-ba0f-4674-be44-5ea6e2196dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:38.109474 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d7edbd42-ba0f-4674-be44-5ea6e2196dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:38.110252 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d7edbd42-ba0f-4674-be44-5ea6e2196dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:38.110691 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d7edbd42-ba0f-4674-be44-5ea6e2196dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:38.245104 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d7edbd42-ba0f-4674-be44-5ea6e2196dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:38.253226 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d7edbd42-ba0f-4674-be44-5ea6e2196dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.155370 Jul 26 12:55:38.254394 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 296/580] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:38 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:38.381926 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c25cd09f-c486-470b-ad37-c7ffa80a2e9b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:38.382597 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c25cd09f-c486-470b-ad37-c7ffa80a2e9b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:38.389076 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c25cd09f-c486-470b-ad37-c7ffa80a2e9b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:38.389534 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c25cd09f-c486-470b-ad37-c7ffa80a2e9b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:38.390299 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c25cd09f-c486-470b-ad37-c7ffa80a2e9b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:38.390747 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c25cd09f-c486-470b-ad37-c7ffa80a2e9b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:38.522180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c25cd09f-c486-470b-ad37-c7ffa80a2e9b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:38.530161 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c25cd09f-c486-470b-ad37-c7ffa80a2e9b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.152880 Jul 26 12:55:38.530739 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 285/581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:38 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:39.275730 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-363e7131-8bab-425c-b874-d19bd87389e3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:39.276452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-363e7131-8bab-425c-b874-d19bd87389e3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:39.284053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-363e7131-8bab-425c-b874-d19bd87389e3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:39.285242 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-363e7131-8bab-425c-b874-d19bd87389e3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:39.285952 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-363e7131-8bab-425c-b874-d19bd87389e3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:39.286623 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-363e7131-8bab-425c-b874-d19bd87389e3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:39.437223 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-363e7131-8bab-425c-b874-d19bd87389e3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:39.445325 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-363e7131-8bab-425c-b874-d19bd87389e3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.173997 Jul 26 12:55:39.445901 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 297/582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:39 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:39.551507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e9e9bbff-494f-435f-bcd8-b25c7546c946 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:39.552151 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e9e9bbff-494f-435f-bcd8-b25c7546c946 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:39.559119 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e9e9bbff-494f-435f-bcd8-b25c7546c946 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:39.559577 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e9e9bbff-494f-435f-bcd8-b25c7546c946 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:39.560384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e9e9bbff-494f-435f-bcd8-b25c7546c946 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:39.560824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e9e9bbff-494f-435f-bcd8-b25c7546c946 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:39.690609 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e9e9bbff-494f-435f-bcd8-b25c7546c946 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:39.699574 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e9e9bbff-494f-435f-bcd8-b25c7546c946 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1732 microversion: 2.1 time: 0.151911 Jul 26 12:55:39.700197 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 286/583] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:39 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:40.349847 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-76012c20-e363-4ab6-b387-4d4eeaa46baf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:40.350360 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-76012c20-e363-4ab6-b387-4d4eeaa46baf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:40.356845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-76012c20-e363-4ab6-b387-4d4eeaa46baf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:40.357301 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-76012c20-e363-4ab6-b387-4d4eeaa46baf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:40.358066 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-76012c20-e363-4ab6-b387-4d4eeaa46baf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:40.358504 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-76012c20-e363-4ab6-b387-4d4eeaa46baf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:40.439788 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-76012c20-e363-4ab6-b387-4d4eeaa46baf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lazy-loading 'services' on Instance uuid e95a1b5c-fb80-4cfd-b51e-ae3692d25794 {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:55:40.467446 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6890a27b-480e-47c3-bdfa-30a13c255c61 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:40.468094 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-6890a27b-480e-47c3-bdfa-30a13c255c61 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:40.474512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6890a27b-480e-47c3-bdfa-30a13c255c61 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:40.474963 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6890a27b-480e-47c3-bdfa-30a13c255c61 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:40.475750 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6890a27b-480e-47c3-bdfa-30a13c255c61 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:40.476192 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6890a27b-480e-47c3-bdfa-30a13c255c61 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:40.512238 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-76012c20-e363-4ab6-b387-4d4eeaa46baf tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794/os-volume_attachments/fc613b9b-a0fe-45d5-9db7-996eeaa3cba2" status: 202 len: 0 microversion: 2.1 time: 0.166593 Jul 26 12:55:40.513072 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 298/584] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Jul 26 12:55:40 2022] DELETE /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794/os-volume_attachments/fc613b9b-a0fe-45d5-9db7-996eeaa3cba2 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:55:40.618585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-6890a27b-480e-47c3-bdfa-30a13c255c61 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:40.626240 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-6890a27b-480e-47c3-bdfa-30a13c255c61 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.162480 Jul 26 12:55:40.626806 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 287/585] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:40 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:40.721732 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c538e96b-0f5c-45c4-9874-3809b2c804b3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:40.723093 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c538e96b-0f5c-45c4-9874-3809b2c804b3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:40.729441 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c538e96b-0f5c-45c4-9874-3809b2c804b3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:40.729891 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c538e96b-0f5c-45c4-9874-3809b2c804b3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:40.730658 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c538e96b-0f5c-45c4-9874-3809b2c804b3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:40.731091 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c538e96b-0f5c-45c4-9874-3809b2c804b3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:40.864831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c538e96b-0f5c-45c4-9874-3809b2c804b3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:40.873053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c538e96b-0f5c-45c4-9874-3809b2c804b3 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1712 microversion: 2.1 time: 0.155546 Jul 26 12:55:40.873624 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 299/586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:40 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:40.989559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2710cd65-079d-4694-b424-75707a784e06 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:40.990361 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2710cd65-079d-4694-b424-75707a784e06 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:40.997958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2710cd65-079d-4694-b424-75707a784e06 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:40.998469 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2710cd65-079d-4694-b424-75707a784e06 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:40.999334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2710cd65-079d-4694-b424-75707a784e06 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:40.999915 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2710cd65-079d-4694-b424-75707a784e06 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:41.063854 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-399c2f2a-e042-45cb-9fab-d50a5c2efeb8 req-3540536d-a2ba-4b02-9ecf-5c896fcd5730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35776963-2d4e-4698-9ad3-b91a5be95f1c", "name": "network-vif-plugged", "status": "completed", "tag": "73ba4e0a-a6ad-4a34-9132-7824ae016df1"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:41.076620 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-399c2f2a-e042-45cb-9fab-d50a5c2efeb8 req-3540536d-a2ba-4b02-9ecf-5c896fcd5730 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:41.077075 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-399c2f2a-e042-45cb-9fab-d50a5c2efeb8 req-3540536d-a2ba-4b02-9ecf-5c896fcd5730 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:41.088518 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-2710cd65-079d-4694-b424-75707a784e06 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] HTTP exception thrown: Cannot 'detach_volume' instance cd47bdd7-0e5c-45eb-a6fb-979300251996 while it is in vm_state rescued Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2710cd65-079d-4694-b424-75707a784e06 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Request method failure captured: Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: DELETE /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-volume_attachments/2fc334ca-2ead-405a-a4cd-68c5af120a2b HTTP/1.1 Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NLseOU0YmIJgrSP1iVFQKab0I0wnEpm8gTrXCuBzFbpoKQTbc_ctfnrVbevburiE7sm0kD-N0KGIA9K76AJduIP27Sf1Y34WxwJtmrVV5YLgZg5S21dVDnnQMNlaZxrh5vweBHLudYSY3-D1c0nDVQKxHmGjC5iwiZ1_78oFSAOL4 Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: d92bfe73c0a54823a88a89f9ae627134 Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:55:41.090129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:55:41.091470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d92bfe73c0a54823a88a89f9ae627134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d92bfe73c0a54823a88a89f9ae627134", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d92bfe73c0a54823a88a89f9ae627134"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d92bfe73c0a54823a88a89f9ae627134"}]}] Jul 26 12:55:41.091470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:55:41.091470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: d92bfe73c0a54823a88a89f9ae627134 Jul 26 12:55:41.091470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:55:41.091470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-ServerRescueNegativeTestJSON-871230559-project Jul 26 12:55:41.091470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:55:41.091470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:55:41.091470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 2b5894762d4b4cc99521bc224d2bddd7 Jul 26 12:55:41.091470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-ServerRescueNegativeTestJSON-871230559-project Jul 26 12:55:41.091470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:55:41.091470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Cannot 'detach_volume' instance cd47bdd7-0e5c-45eb-a6fb-979300251996 while it is in vm_state rescued Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'server_id': 'cd47bdd7-0e5c-45eb-a6fb-979300251996', 'id': '2fc334ca-2ead-405a-a4cd-68c5af120a2b'} Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cd47bdd7-0e5c-45eb-a6fb-979300251996 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:55:41.092507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cd47bdd7-0e5c-45eb-a6fb-979300251996 while it is in vm_state rescued Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cd47bdd7-0e5c-45eb-a6fb-979300251996 while it is in vm_state rescued Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:55:41.093961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2710cd65-079d-4694-b424-75707a784e06 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Returning 409 to user: Cannot 'detach_volume' instance cd47bdd7-0e5c-45eb-a6fb-979300251996 while it is in vm_state rescued {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:55:41.095936 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2710cd65-079d-4694-b424-75707a784e06 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-volume_attachments/2fc334ca-2ead-405a-a4cd-68c5af120a2b" status: 409 len: 152 microversion: 2.1 time: 0.106711 Jul 26 12:55:41.097189 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 288/587] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Jul 26 12:55:40 2022] DELETE /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-volume_attachments/2fc334ca-2ead-405a-a4cd-68c5af120a2b => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 12:55:41.102868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-826984b8-d9f3-473e-ade8-b9ac565d9444 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:41.103084 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-826984b8-d9f3-473e-ade8-b9ac565d9444 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:41.109915 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-826984b8-d9f3-473e-ade8-b9ac565d9444 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:41.110372 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-826984b8-d9f3-473e-ade8-b9ac565d9444 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:41.111217 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-399c2f2a-e042-45cb-9fab-d50a5c2efeb8 req-3540536d-a2ba-4b02-9ecf-5c896fcd5730 service nova] Creating event network-vif-plugged:73ba4e0a-a6ad-4a34-9132-7824ae016df1 for instance 35776963-2d4e-4698-9ad3-b91a5be95f1c on hv-cinder-85093 Jul 26 12:55:41.111356 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-826984b8-d9f3-473e-ade8-b9ac565d9444 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:41.111782 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-826984b8-d9f3-473e-ade8-b9ac565d9444 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:41.116953 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-399c2f2a-e042-45cb-9fab-d50a5c2efeb8 req-3540536d-a2ba-4b02-9ecf-5c896fcd5730 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057519 Jul 26 12:55:41.117553 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 300/588] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:55:41.181298 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-826984b8-d9f3-473e-ade8-b9ac565d9444 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "POST /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/action" status: 202 len: 0 microversion: 2.1 time: 0.082295 Jul 26 12:55:41.186046 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 289/589] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 12:55:41 2022] POST /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:55:41.193041 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8afdb32b-a6af-4eee-a2e2-912998d1c526 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:41.193422 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8afdb32b-a6af-4eee-a2e2-912998d1c526 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:41.200803 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8afdb32b-a6af-4eee-a2e2-912998d1c526 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:41.201278 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8afdb32b-a6af-4eee-a2e2-912998d1c526 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:41.202048 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8afdb32b-a6af-4eee-a2e2-912998d1c526 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:41.202518 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8afdb32b-a6af-4eee-a2e2-912998d1c526 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:41.351210 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8afdb32b-a6af-4eee-a2e2-912998d1c526 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:41.364057 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8afdb32b-a6af-4eee-a2e2-912998d1c526 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1720 microversion: 2.1 time: 0.175406 Jul 26 12:55:41.364974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 301/590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:41 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:41.642456 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9ead8362-7ede-4a59-b844-1b712c850f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:41.643037 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9ead8362-7ede-4a59-b844-1b712c850f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:41.648725 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d3d646d0-b250-41f8-9351-53a6ed1f90de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:41.649479 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d3d646d0-b250-41f8-9351-53a6ed1f90de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:41.649763 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9ead8362-7ede-4a59-b844-1b712c850f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:41.650487 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9ead8362-7ede-4a59-b844-1b712c850f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:41.651807 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9ead8362-7ede-4a59-b844-1b712c850f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:41.652262 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9ead8362-7ede-4a59-b844-1b712c850f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:41.656321 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d3d646d0-b250-41f8-9351-53a6ed1f90de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:41.656872 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d3d646d0-b250-41f8-9351-53a6ed1f90de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:41.657762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d3d646d0-b250-41f8-9351-53a6ed1f90de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:41.658481 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d3d646d0-b250-41f8-9351-53a6ed1f90de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:41.680841 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9ead8362-7ede-4a59-b844-1b712c850f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Going to try to terminate instance {{(pid=129307) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:55:41.773827 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:41.806467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9ead8362-7ede-4a59-b844-1b712c850f49 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 204 len: 0 microversion: 2.1 time: 0.168073 Jul 26 12:55:41.807496 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 290/591] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:55:41 2022] DELETE /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:55:41.814613 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d3d646d0-b250-41f8-9351-53a6ed1f90de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:41.819087 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-766f22fe-916d-44af-a285-c4a8ea432c37 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:41.820347 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-766f22fe-916d-44af-a285-c4a8ea432c37 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:41.823086 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d3d646d0-b250-41f8-9351-53a6ed1f90de tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.178474 Jul 26 12:55:41.823943 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 302/592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:41 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:41.826384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-766f22fe-916d-44af-a285-c4a8ea432c37 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:41.826824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-766f22fe-916d-44af-a285-c4a8ea432c37 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:41.827592 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-766f22fe-916d-44af-a285-c4a8ea432c37 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:41.828067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-766f22fe-916d-44af-a285-c4a8ea432c37 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:41.962977 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-766f22fe-916d-44af-a285-c4a8ea432c37 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:41.970403 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-766f22fe-916d-44af-a285-c4a8ea432c37 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1514 microversion: 2.1 time: 0.158008 Jul 26 12:55:41.970962 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 291/593] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:41 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:42.397724 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-84c3cfa5-9128-4042-9f09-3deb3f43984c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:42.398324 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-84c3cfa5-9128-4042-9f09-3deb3f43984c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:42.404810 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-84c3cfa5-9128-4042-9f09-3deb3f43984c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:42.405258 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-84c3cfa5-9128-4042-9f09-3deb3f43984c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:42.406017 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-84c3cfa5-9128-4042-9f09-3deb3f43984c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:42.406452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-84c3cfa5-9128-4042-9f09-3deb3f43984c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:42.535173 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-84c3cfa5-9128-4042-9f09-3deb3f43984c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:42.543103 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-84c3cfa5-9128-4042-9f09-3deb3f43984c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1720 microversion: 2.1 time: 0.149956 Jul 26 12:55:42.543685 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 303/594] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:42 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:42.844368 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c6c38214-e98c-4fc9-b8f5-4504b4d16e9c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:42.844991 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c6c38214-e98c-4fc9-b8f5-4504b4d16e9c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:42.851462 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c6c38214-e98c-4fc9-b8f5-4504b4d16e9c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:42.851946 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c6c38214-e98c-4fc9-b8f5-4504b4d16e9c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:42.852710 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c6c38214-e98c-4fc9-b8f5-4504b4d16e9c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:42.853148 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c6c38214-e98c-4fc9-b8f5-4504b4d16e9c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:42.985307 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c6c38214-e98c-4fc9-b8f5-4504b4d16e9c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:42.992209 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5b205966-056d-4239-b3c6-c15ab06fb65a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:42.992817 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-5b205966-056d-4239-b3c6-c15ab06fb65a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:42.993311 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c6c38214-e98c-4fc9-b8f5-4504b4d16e9c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.153079 Jul 26 12:55:42.993876 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 292/595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:42 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:42.999031 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5b205966-056d-4239-b3c6-c15ab06fb65a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:42.999482 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5b205966-056d-4239-b3c6-c15ab06fb65a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:43.000273 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5b205966-056d-4239-b3c6-c15ab06fb65a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:43.000709 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5b205966-056d-4239-b3c6-c15ab06fb65a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:43.128848 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-5b205966-056d-4239-b3c6-c15ab06fb65a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:43.136287 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-5b205966-056d-4239-b3c6-c15ab06fb65a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1514 microversion: 2.1 time: 0.148450 Jul 26 12:55:43.136851 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 304/596] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:42 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:43.564366 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-a8aa53ed-298f-4ee9-8b71-52fe31989825 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:43.564970 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-a8aa53ed-298f-4ee9-8b71-52fe31989825 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:43.570889 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a8aa53ed-298f-4ee9-8b71-52fe31989825 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:43.571338 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a8aa53ed-298f-4ee9-8b71-52fe31989825 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:43.572121 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a8aa53ed-298f-4ee9-8b71-52fe31989825 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:43.572549 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a8aa53ed-298f-4ee9-8b71-52fe31989825 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:43.702754 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-a8aa53ed-298f-4ee9-8b71-52fe31989825 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:43.711108 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-a8aa53ed-298f-4ee9-8b71-52fe31989825 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1720 microversion: 2.1 time: 0.150523 Jul 26 12:55:43.711680 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 293/597] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:43 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:44.014282 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ac3b8de4-b2db-40a0-9a3f-ec91b0a30cbe tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:44.014896 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ac3b8de4-b2db-40a0-9a3f-ec91b0a30cbe tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:44.021782 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ac3b8de4-b2db-40a0-9a3f-ec91b0a30cbe tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:44.022256 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ac3b8de4-b2db-40a0-9a3f-ec91b0a30cbe tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:44.023132 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ac3b8de4-b2db-40a0-9a3f-ec91b0a30cbe tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:44.023614 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ac3b8de4-b2db-40a0-9a3f-ec91b0a30cbe tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:44.039200 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:44.156544 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f8346775-4e80-4268-add0-49b068ed3a1a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:44.157157 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f8346775-4e80-4268-add0-49b068ed3a1a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:44.168673 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f8346775-4e80-4268-add0-49b068ed3a1a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:44.169164 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f8346775-4e80-4268-add0-49b068ed3a1a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:44.169965 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f8346775-4e80-4268-add0-49b068ed3a1a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:44.170438 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f8346775-4e80-4268-add0-49b068ed3a1a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:44.312989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f8346775-4e80-4268-add0-49b068ed3a1a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:44.320827 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f8346775-4e80-4268-add0-49b068ed3a1a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1514 microversion: 2.1 time: 0.168109 Jul 26 12:55:44.321630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 294/598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:44 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:44.412679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ac3b8de4-b2db-40a0-9a3f-ec91b0a30cbe tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:44.420912 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ac3b8de4-b2db-40a0-9a3f-ec91b0a30cbe tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1368 microversion: 2.1 time: 0.410430 Jul 26 12:55:44.421512 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 305/599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:44 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1368 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:44.733124 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d9274afa-d5b4-47e8-a69e-cfcb99a10069 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:44.733748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d9274afa-d5b4-47e8-a69e-cfcb99a10069 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:44.739957 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d9274afa-d5b4-47e8-a69e-cfcb99a10069 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:44.740415 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d9274afa-d5b4-47e8-a69e-cfcb99a10069 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:44.741181 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d9274afa-d5b4-47e8-a69e-cfcb99a10069 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:44.741622 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d9274afa-d5b4-47e8-a69e-cfcb99a10069 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:44.869725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d9274afa-d5b4-47e8-a69e-cfcb99a10069 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:44.878395 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d9274afa-d5b4-47e8-a69e-cfcb99a10069 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1720 microversion: 2.1 time: 0.149104 Jul 26 12:55:44.879437 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 295/600] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:44 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:45.342174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-fb532751-73a1-4a7d-851d-7b80f1fba69a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:45.342992 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-fb532751-73a1-4a7d-851d-7b80f1fba69a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:45.350022 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fb532751-73a1-4a7d-851d-7b80f1fba69a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:45.350552 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fb532751-73a1-4a7d-851d-7b80f1fba69a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:45.351327 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fb532751-73a1-4a7d-851d-7b80f1fba69a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:45.351798 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fb532751-73a1-4a7d-851d-7b80f1fba69a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:45.445465 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e596a4f3-c4fd-46f6-9f80-bb7b8261472c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:45.446080 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e596a4f3-c4fd-46f6-9f80-bb7b8261472c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:45.454051 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e596a4f3-c4fd-46f6-9f80-bb7b8261472c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:45.454750 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e596a4f3-c4fd-46f6-9f80-bb7b8261472c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:45.455723 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e596a4f3-c4fd-46f6-9f80-bb7b8261472c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:45.456316 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e596a4f3-c4fd-46f6-9f80-bb7b8261472c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:45.491153 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-fb532751-73a1-4a7d-851d-7b80f1fba69a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:45.498825 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-fb532751-73a1-4a7d-851d-7b80f1fba69a tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1514 microversion: 2.1 time: 0.160522 Jul 26 12:55:45.499394 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 306/601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:45 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:45.566040 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-89008065-c365-4de5-92f4-67f4134efbfc req-f519727f-de63-4c21-b8ac-70b0fe37cec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e95a1b5c-fb80-4cfd-b51e-ae3692d25794", "name": "network-vif-deleted", "tag": "0de30c07-1b45-4b27-a4af-035abd1eefd3"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:45.575742 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-89008065-c365-4de5-92f4-67f4134efbfc req-f519727f-de63-4c21-b8ac-70b0fe37cec3 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:45.576180 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-89008065-c365-4de5-92f4-67f4134efbfc req-f519727f-de63-4c21-b8ac-70b0fe37cec3 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:45.587193 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-89008065-c365-4de5-92f4-67f4134efbfc req-f519727f-de63-4c21-b8ac-70b0fe37cec3 service nova] Creating event network-vif-deleted:0de30c07-1b45-4b27-a4af-035abd1eefd3 for instance e95a1b5c-fb80-4cfd-b51e-ae3692d25794 on hv-cinder-85093 Jul 26 12:55:45.592210 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-89008065-c365-4de5-92f4-67f4134efbfc req-f519727f-de63-4c21-b8ac-70b0fe37cec3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029817 Jul 26 12:55:45.592808 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 307/602] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:55:45.631669 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e596a4f3-c4fd-46f6-9f80-bb7b8261472c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:45.639212 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e596a4f3-c4fd-46f6-9f80-bb7b8261472c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1559 microversion: 2.1 time: 0.198384 Jul 26 12:55:45.639886 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 296/603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:45 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:55:45.662888 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-136ff787-3e9c-461b-bff6-b888e01a6489 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:45.663486 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-136ff787-3e9c-461b-bff6-b888e01a6489 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:45.671253 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-136ff787-3e9c-461b-bff6-b888e01a6489 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:45.671728 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-136ff787-3e9c-461b-bff6-b888e01a6489 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:45.673144 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-136ff787-3e9c-461b-bff6-b888e01a6489 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:45.673915 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-136ff787-3e9c-461b-bff6-b888e01a6489 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:45.756804 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-136ff787-3e9c-461b-bff6-b888e01a6489 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099867 Jul 26 12:55:45.757400 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 308/604] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Jul 26 12:55:45 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:55:45.901370 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6e503329-efba-496e-9e57-c29a38c98bda tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:45.902108 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-6e503329-efba-496e-9e57-c29a38c98bda tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:45.908399 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6e503329-efba-496e-9e57-c29a38c98bda tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:45.908857 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6e503329-efba-496e-9e57-c29a38c98bda tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:45.909633 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6e503329-efba-496e-9e57-c29a38c98bda tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:45.910704 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6e503329-efba-496e-9e57-c29a38c98bda tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:46.053538 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-6e503329-efba-496e-9e57-c29a38c98bda tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:46.061630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-6e503329-efba-496e-9e57-c29a38c98bda tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1720 microversion: 2.1 time: 0.164253 Jul 26 12:55:46.062206 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 297/605] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:45 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:46.522276 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-cc760ccb-a71a-4b4d-8d85-3e0265bede33 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:46.522977 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-cc760ccb-a71a-4b4d-8d85-3e0265bede33 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:46.529283 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cc760ccb-a71a-4b4d-8d85-3e0265bede33 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:46.529776 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cc760ccb-a71a-4b4d-8d85-3e0265bede33 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:46.530543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cc760ccb-a71a-4b4d-8d85-3e0265bede33 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:46.530981 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cc760ccb-a71a-4b4d-8d85-3e0265bede33 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:46.634408 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-cc760ccb-a71a-4b4d-8d85-3e0265bede33 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:46.642229 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-cc760ccb-a71a-4b4d-8d85-3e0265bede33 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1472 microversion: 2.1 time: 0.125499 Jul 26 12:55:46.642813 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 309/606] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:46 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1472 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:46.733849 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-2f56ad51-31d0-400b-bf4b-5c0dfc3100cd req-8ea314e5-0894-4830-86ca-996db0724569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35776963-2d4e-4698-9ad3-b91a5be95f1c", "tag": "73ba4e0a-a6ad-4a34-9132-7824ae016df1"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:46.744793 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-2f56ad51-31d0-400b-bf4b-5c0dfc3100cd req-8ea314e5-0894-4830-86ca-996db0724569 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:46.745238 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-2f56ad51-31d0-400b-bf4b-5c0dfc3100cd req-8ea314e5-0894-4830-86ca-996db0724569 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:46.758875 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-2f56ad51-31d0-400b-bf4b-5c0dfc3100cd req-8ea314e5-0894-4830-86ca-996db0724569 service nova] Creating event network-changed:73ba4e0a-a6ad-4a34-9132-7824ae016df1 for instance 35776963-2d4e-4698-9ad3-b91a5be95f1c on hv-cinder-85093 Jul 26 12:55:46.764762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-2f56ad51-31d0-400b-bf4b-5c0dfc3100cd req-8ea314e5-0894-4830-86ca-996db0724569 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034864 Jul 26 12:55:46.765458 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 298/607] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:55:47.084658 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-861626c3-4dcc-48a2-b30b-92bc216ab458 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:47.085270 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-861626c3-4dcc-48a2-b30b-92bc216ab458 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:47.091503 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-861626c3-4dcc-48a2-b30b-92bc216ab458 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:47.091975 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-861626c3-4dcc-48a2-b30b-92bc216ab458 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:47.092740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-861626c3-4dcc-48a2-b30b-92bc216ab458 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:47.093171 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-861626c3-4dcc-48a2-b30b-92bc216ab458 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:47.223239 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-861626c3-4dcc-48a2-b30b-92bc216ab458 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:47.231985 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-861626c3-4dcc-48a2-b30b-92bc216ab458 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1720 microversion: 2.1 time: 0.152168 Jul 26 12:55:47.232560 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 310/608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:47 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:47.665228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-7678f11b-5550-4879-8f49-b5d2720b1d05 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:47.665921 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-7678f11b-5550-4879-8f49-b5d2720b1d05 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:47.672776 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7678f11b-5550-4879-8f49-b5d2720b1d05 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:47.673237 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7678f11b-5550-4879-8f49-b5d2720b1d05 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:47.674168 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7678f11b-5550-4879-8f49-b5d2720b1d05 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:47.674600 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7678f11b-5550-4879-8f49-b5d2720b1d05 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:47.706421 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7678f11b-5550-4879-8f49-b5d2720b1d05 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:47.706903 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7678f11b-5550-4879-8f49-b5d2720b1d05 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:47.707472 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-7678f11b-5550-4879-8f49-b5d2720b1d05 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lazy-loading 'fault' on Instance uuid e95a1b5c-fb80-4cfd-b51e-ae3692d25794 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:55:47.752677 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-7678f11b-5550-4879-8f49-b5d2720b1d05 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a6832c70c0c401985bc4f26a787080f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4a3dadafc44483ad16923db53db457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:47.761011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-7678f11b-5550-4879-8f49-b5d2720b1d05 tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 200 len: 1308 microversion: 2.1 time: 0.100020 Jul 26 12:55:47.761839 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 299/609] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:47 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:48.254931 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0a6c8058-1000-4edb-89eb-dcc92315756f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:48.255761 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0a6c8058-1000-4edb-89eb-dcc92315756f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:48.262800 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0a6c8058-1000-4edb-89eb-dcc92315756f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:48.263310 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0a6c8058-1000-4edb-89eb-dcc92315756f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:48.264196 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0a6c8058-1000-4edb-89eb-dcc92315756f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:48.264703 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0a6c8058-1000-4edb-89eb-dcc92315756f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:48.392547 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0a6c8058-1000-4edb-89eb-dcc92315756f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:55:48.400615 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0a6c8058-1000-4edb-89eb-dcc92315756f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1726 microversion: 2.1 time: 0.150642 Jul 26 12:55:48.401176 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 311/610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:48 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:55:48.422204 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3ea88cc5-ec76-461b-bf7a-d49c6d249b25 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:48.422624 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3ea88cc5-ec76-461b-bf7a-d49c6d249b25 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:48.429178 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3ea88cc5-ec76-461b-bf7a-d49c6d249b25 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:48.429625 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3ea88cc5-ec76-461b-bf7a-d49c6d249b25 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:48.430377 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3ea88cc5-ec76-461b-bf7a-d49c6d249b25 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:48.430809 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3ea88cc5-ec76-461b-bf7a-d49c6d249b25 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:48.511585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3ea88cc5-ec76-461b-bf7a-d49c6d249b25 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093214 Jul 26 12:55:48.512227 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 300/611] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Jul 26 12:55:48 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:55:48.783528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-df8a96a0-2f1b-4067-bcc3-45fb93c16e9c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:55:48.784344 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-df8a96a0-2f1b-4067-bcc3-45fb93c16e9c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] [instance: e95a1b5c-fb80-4cfd-b51e-ae3692d25794] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:55:48.787404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:55:48.796239 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-df8a96a0-2f1b-4067-bcc3-45fb93c16e9c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:48.796933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-df8a96a0-2f1b-4067-bcc3-45fb93c16e9c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:48.797978 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-df8a96a0-2f1b-4067-bcc3-45fb93c16e9c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:48.798462 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-df8a96a0-2f1b-4067-bcc3-45fb93c16e9c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:48.813020 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-df8a96a0-2f1b-4067-bcc3-45fb93c16e9c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] HTTP exception thrown: Instance e95a1b5c-fb80-4cfd-b51e-ae3692d25794 could not be found. Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-df8a96a0-2f1b-4067-bcc3-45fb93c16e9c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Request method failure captured: Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 HTTP/1.1 Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-O-f42IcWxDs9uAesIjlEGDyOwLpuU4gT_2kdIYkBH1XW9Qwf5kEZX0mkN5Fk-XDbaWJwIPrM8uSNGeMIYopShNsxWhyXzpTRfpl_tGzTjogaRmA82Dh8SaA5xw33ZFQjgjmv0LfKQVVeagUMww2fUNPU4N3OwJdkEc3-Iq2ZjMvoQ Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: fa4a3dadafc44483ad16923db53db457 Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1919758244 Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:55:48.814680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:55:48.817039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fa4a3dadafc44483ad16923db53db457"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fa4a3dadafc44483ad16923db53db457", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fa4a3dadafc44483ad16923db53db457"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fa4a3dadafc44483ad16923db53db457"}]}] Jul 26 12:55:48.817039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-VolumesSnapshotTestJSON-1919758244 Jul 26 12:55:48.817039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: fa4a3dadafc44483ad16923db53db457 Jul 26 12:55:48.817039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1919758244 Jul 26 12:55:48.817039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-VolumesSnapshotTestJSON-1919758244-project Jul 26 12:55:48.817039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:55:48.817039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:55:48.817039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 7a6832c70c0c401985bc4f26a787080f Jul 26 12:55:48.817039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-VolumesSnapshotTestJSON-1919758244-project Jul 26 12:55:48.817039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:55:48.817039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance e95a1b5c-fb80-4cfd-b51e-ae3692d25794 could not be found. Jul 26 12:55:48.817039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': 'e95a1b5c-fb80-4cfd-b51e-ae3692d25794'} Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e95a1b5c-fb80-4cfd-b51e-ae3692d25794 could not be found. Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:55:48.817818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e95a1b5c-fb80-4cfd-b51e-ae3692d25794 could not be found. Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e95a1b5c-fb80-4cfd-b51e-ae3692d25794 could not be found. Jul 26 12:55:48.819056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:55:48.820203 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-df8a96a0-2f1b-4067-bcc3-45fb93c16e9c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] Returning 404 to user: Instance e95a1b5c-fb80-4cfd-b51e-ae3692d25794 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:55:48.820203 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-df8a96a0-2f1b-4067-bcc3-45fb93c16e9c tempest-VolumesSnapshotTestJSON-1919758244 tempest-VolumesSnapshotTestJSON-1919758244-project] 10.222.0.20 "GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794" status: 404 len: 111 microversion: 2.1 time: 0.036625 Jul 26 12:55:48.820203 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 312/612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:55:48 2022] GET /compute/v2.1/servers/e95a1b5c-fb80-4cfd-b51e-ae3692d25794 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:55:49.760198 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-354ecfbc-ff57-4f33-90ea-c2596f5e7e19 req-e0d3df54-d6e2-420b-bda7-f6f2ea3d9da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd47bdd7-0e5c-45eb-a6fb-979300251996", "tag": "0da5fda1-917d-45ee-bba6-4a249f129d9a"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:49.770242 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-354ecfbc-ff57-4f33-90ea-c2596f5e7e19 req-e0d3df54-d6e2-420b-bda7-f6f2ea3d9da8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:49.770994 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-354ecfbc-ff57-4f33-90ea-c2596f5e7e19 req-e0d3df54-d6e2-420b-bda7-f6f2ea3d9da8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:49.784226 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-354ecfbc-ff57-4f33-90ea-c2596f5e7e19 req-e0d3df54-d6e2-420b-bda7-f6f2ea3d9da8 service nova] Creating event network-changed:0da5fda1-917d-45ee-bba6-4a249f129d9a for instance cd47bdd7-0e5c-45eb-a6fb-979300251996 on hv-cinder-85093 Jul 26 12:55:49.791609 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-354ecfbc-ff57-4f33-90ea-c2596f5e7e19 req-e0d3df54-d6e2-420b-bda7-f6f2ea3d9da8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035562 Jul 26 12:55:49.792413 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 301/613] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:55:51.805438 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-c9087c4d-9fe8-45cd-8d8b-4c82ca381d45 req-95a0fc41-5f31-494f-99ef-116ac279aa6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd47bdd7-0e5c-45eb-a6fb-979300251996", "tag": "0da5fda1-917d-45ee-bba6-4a249f129d9a"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:55:51.815602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-c9087c4d-9fe8-45cd-8d8b-4c82ca381d45 req-95a0fc41-5f31-494f-99ef-116ac279aa6a service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:55:51.816081 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-c9087c4d-9fe8-45cd-8d8b-4c82ca381d45 req-95a0fc41-5f31-494f-99ef-116ac279aa6a service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:55:51.826997 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-c9087c4d-9fe8-45cd-8d8b-4c82ca381d45 req-95a0fc41-5f31-494f-99ef-116ac279aa6a service nova] Creating event network-changed:0da5fda1-917d-45ee-bba6-4a249f129d9a for instance cd47bdd7-0e5c-45eb-a6fb-979300251996 on hv-cinder-85093 Jul 26 12:55:51.832477 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-c9087c4d-9fe8-45cd-8d8b-4c82ca381d45 req-95a0fc41-5f31-494f-99ef-116ac279aa6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030246 Jul 26 12:55:51.833041 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 313/614] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:56:10.409991 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:10.410737 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=58 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:10.415908 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1f9266b4-7ced-4c1a-8aa2-37358527128f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:10.416489 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1f9266b4-7ced-4c1a-8aa2-37358527128f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:10.424124 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1f9266b4-7ced-4c1a-8aa2-37358527128f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:10.424592 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1f9266b4-7ced-4c1a-8aa2-37358527128f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:10.425361 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1f9266b4-7ced-4c1a-8aa2-37358527128f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:10.425803 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1f9266b4-7ced-4c1a-8aa2-37358527128f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:10.454496 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1f9266b4-7ced-4c1a-8aa2-37358527128f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/os-volume_attachments/edfc3349-7922-479d-b5d7-12e8d1316fe3" status: 200 len: 194 microversion: 2.20 time: 0.046141 Jul 26 12:56:10.455009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 302/615] 10.222.0.20 () {60 vars in 1454 bytes} [Tue Jul 26 12:56:10 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/os-volume_attachments/edfc3349-7922-479d-b5d7-12e8d1316fe3 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:56:10.523886 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5db5ec97-8244-4300-be54-17c12579249f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:10.524445 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-5db5ec97-8244-4300-be54-17c12579249f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:10.527242 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=3 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:10.527911 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=37 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:10.534178 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5db5ec97-8244-4300-be54-17c12579249f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:10.534627 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5db5ec97-8244-4300-be54-17c12579249f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:10.535428 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5db5ec97-8244-4300-be54-17c12579249f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:10.535893 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5db5ec97-8244-4300-be54-17c12579249f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:10.618422 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-5db5ec97-8244-4300-be54-17c12579249f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lazy-loading 'services' on Instance uuid 20220b7e-2897-4f0c-98da-3f352aa39ec2 {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:56:10.694894 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-5db5ec97-8244-4300-be54-17c12579249f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/os-volume_attachments/edfc3349-7922-479d-b5d7-12e8d1316fe3" status: 202 len: 0 microversion: 2.20 time: 0.175694 Jul 26 12:56:10.695659 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 314/616] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Jul 26 12:56:10 2022] DELETE /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/os-volume_attachments/edfc3349-7922-479d-b5d7-12e8d1316fe3 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:56:10.704358 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d6c14704-dd6b-4efb-835b-4e7eefc2fb20 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:10.706594 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d6c14704-dd6b-4efb-835b-4e7eefc2fb20 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:10.713564 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6c14704-dd6b-4efb-835b-4e7eefc2fb20 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:10.714028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6c14704-dd6b-4efb-835b-4e7eefc2fb20 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:10.714823 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6c14704-dd6b-4efb-835b-4e7eefc2fb20 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:10.715296 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6c14704-dd6b-4efb-835b-4e7eefc2fb20 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:10.746329 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d6c14704-dd6b-4efb-835b-4e7eefc2fb20 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046165 Jul 26 12:56:10.746973 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 303/617] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Jul 26 12:56:10 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:56:11.760188 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a460122c-578a-4645-a2b8-cf756372b272 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:11.762484 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-a460122c-578a-4645-a2b8-cf756372b272 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:11.769016 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a460122c-578a-4645-a2b8-cf756372b272 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:11.769458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a460122c-578a-4645-a2b8-cf756372b272 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:11.770227 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a460122c-578a-4645-a2b8-cf756372b272 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:11.770689 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a460122c-578a-4645-a2b8-cf756372b272 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:11.802436 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a460122c-578a-4645-a2b8-cf756372b272 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047361 Jul 26 12:56:11.803013 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 315/618] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Jul 26 12:56:11 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:11.866761 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-a890ba1e-bcc1-4db7-90eb-6d6057c5053f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:11.867433 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-a890ba1e-bcc1-4db7-90eb-6d6057c5053f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:11.874111 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a890ba1e-bcc1-4db7-90eb-6d6057c5053f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:11.874557 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a890ba1e-bcc1-4db7-90eb-6d6057c5053f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:11.875367 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a890ba1e-bcc1-4db7-90eb-6d6057c5053f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:11.875848 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a890ba1e-bcc1-4db7-90eb-6d6057c5053f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:11.904741 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-a890ba1e-bcc1-4db7-90eb-6d6057c5053f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Going to try to terminate instance {{(pid=129307) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:56:11.985128 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-a890ba1e-bcc1-4db7-90eb-6d6057c5053f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 204 len: 0 microversion: 2.20 time: 0.122760 Jul 26 12:56:11.985752 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 304/619] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Jul 26 12:56:11 2022] DELETE /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 12:56:11.996487 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7d64121d-1cd7-4a76-ae8d-20f4c30af145 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:11.997121 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7d64121d-1cd7-4a76-ae8d-20f4c30af145 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:12.004857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d64121d-1cd7-4a76-ae8d-20f4c30af145 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:12.005303 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d64121d-1cd7-4a76-ae8d-20f4c30af145 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:12.006647 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d64121d-1cd7-4a76-ae8d-20f4c30af145 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:12.007081 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d64121d-1cd7-4a76-ae8d-20f4c30af145 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:12.144705 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7d64121d-1cd7-4a76-ae8d-20f4c30af145 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:12.152840 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7d64121d-1cd7-4a76-ae8d-20f4c30af145 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:12.154366 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7d64121d-1cd7-4a76-ae8d-20f4c30af145 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:12.155528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7d64121d-1cd7-4a76-ae8d-20f4c30af145 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.165061 Jul 26 12:56:12.156113 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 316/620] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:56:11 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:56:13.179833 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-a93c1ef1-a071-46ce-8a57-b7b8c5b6ddbf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:13.180650 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-a93c1ef1-a071-46ce-8a57-b7b8c5b6ddbf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:13.187756 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a93c1ef1-a071-46ce-8a57-b7b8c5b6ddbf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:13.188205 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a93c1ef1-a071-46ce-8a57-b7b8c5b6ddbf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:13.188989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a93c1ef1-a071-46ce-8a57-b7b8c5b6ddbf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:13.189418 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a93c1ef1-a071-46ce-8a57-b7b8c5b6ddbf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:13.335512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-a93c1ef1-a071-46ce-8a57-b7b8c5b6ddbf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:13.343395 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-a93c1ef1-a071-46ce-8a57-b7b8c5b6ddbf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:13.344930 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-a93c1ef1-a071-46ce-8a57-b7b8c5b6ddbf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:13.346097 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-a93c1ef1-a071-46ce-8a57-b7b8c5b6ddbf tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1725 microversion: 2.20 time: 0.171364 Jul 26 12:56:13.346656 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 305/621] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:56:13 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:56:14.370108 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-060552b4-706c-4c93-83a5-677f6dcc7a46 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:14.370882 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-060552b4-706c-4c93-83a5-677f6dcc7a46 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:14.377393 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-060552b4-706c-4c93-83a5-677f6dcc7a46 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:14.378106 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-060552b4-706c-4c93-83a5-677f6dcc7a46 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:14.378882 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-060552b4-706c-4c93-83a5-677f6dcc7a46 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:14.379323 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-060552b4-706c-4c93-83a5-677f6dcc7a46 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:14.660726 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-060552b4-706c-4c93-83a5-677f6dcc7a46 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:14.672351 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-060552b4-706c-4c93-83a5-677f6dcc7a46 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:14.673871 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-060552b4-706c-4c93-83a5-677f6dcc7a46 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:14.675040 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-060552b4-706c-4c93-83a5-677f6dcc7a46 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 200 len: 1658 microversion: 2.20 time: 0.308823 Jul 26 12:56:14.675779 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 317/622] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:56:14 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 1658 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:56:14.792135 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-598f4332-c254-46a0-9484-0a084480e60e req-d7cb5aa1-40f6-46ce-87cc-94407c9b7c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20220b7e-2897-4f0c-98da-3f352aa39ec2", "name": "network-vif-deleted", "tag": "32e67b58-c4c4-4a07-b551-08232595ea42"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:14.803998 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-598f4332-c254-46a0-9484-0a084480e60e req-d7cb5aa1-40f6-46ce-87cc-94407c9b7c82 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:14.804505 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-598f4332-c254-46a0-9484-0a084480e60e req-d7cb5aa1-40f6-46ce-87cc-94407c9b7c82 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:14.831805 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-598f4332-c254-46a0-9484-0a084480e60e req-d7cb5aa1-40f6-46ce-87cc-94407c9b7c82 service nova] Creating event network-vif-deleted:32e67b58-c4c4-4a07-b551-08232595ea42 for instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 on hv-cinder-85093 Jul 26 12:56:14.838207 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-598f4332-c254-46a0-9484-0a084480e60e req-d7cb5aa1-40f6-46ce-87cc-94407c9b7c82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049548 Jul 26 12:56:14.839064 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 306/623] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:56:15.699289 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ba2f1f60-9989-42c8-930f-abbde7e3bf58 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:15.699936 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ba2f1f60-9989-42c8-930f-abbde7e3bf58 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:15.706816 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ba2f1f60-9989-42c8-930f-abbde7e3bf58 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:15.707266 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ba2f1f60-9989-42c8-930f-abbde7e3bf58 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:15.708071 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ba2f1f60-9989-42c8-930f-abbde7e3bf58 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:15.708511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ba2f1f60-9989-42c8-930f-abbde7e3bf58 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:15.722469 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-ba2f1f60-9989-42c8-930f-abbde7e3bf58 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] HTTP exception thrown: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ba2f1f60-9989-42c8-930f-abbde7e3bf58 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Request method failure captured: Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 HTTP/1.1 Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-NPAWW1NBdMRtqW3YqJgaBR_jRTQlhyTkofW4Txb48VZtZWOfmn7eNQimrkw3fjzuDkk61QqxSjhECSPCYfBaUc3Xi9DvazYxnpgAXFRskkbxiK_Nu-Q3Sy0NhyGYgojG405CAt9EYtcyaiT1UjOSUzIXoCaANw1wCbIVlZZDQuNHo Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: a93dd858fb7a40fbbb679fbe676b1f3c Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:56:15.724165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:56:15.725837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a93dd858fb7a40fbbb679fbe676b1f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a93dd858fb7a40fbbb679fbe676b1f3c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a93dd858fb7a40fbbb679fbe676b1f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a93dd858fb7a40fbbb679fbe676b1f3c"}]}] Jul 26 12:56:15.725837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:56:15.725837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: a93dd858fb7a40fbbb679fbe676b1f3c Jul 26 12:56:15.725837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:56:15.725837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-AttachVolumeShelveTestJSON-2123661871-project Jul 26 12:56:15.725837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:56:15.725837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:56:15.725837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 17b7e2c1b1b04366b99e9ab892aeb835 Jul 26 12:56:15.725837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2123661871-project Jul 26 12:56:15.725837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:56:15.725837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:56:15.725837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '20220b7e-2897-4f0c-98da-3f352aa39ec2'} Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:56:15.726715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:56:15.728251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:56:15.729357 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ba2f1f60-9989-42c8-930f-abbde7e3bf58 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Returning 404 to user: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:56:15.729357 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ba2f1f60-9989-42c8-930f-abbde7e3bf58 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 404 len: 111 microversion: 2.20 time: 0.030405 Jul 26 12:56:15.729357 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 318/624] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:56:15 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 12:56:15.735159 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9cf60fcb-838e-45cc-9cc4-42e7fcbbf9ce tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '.version_select at 0x7f65f52859d0>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:15.754592 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9cf60fcb-838e-45cc-9cc4-42e7fcbbf9ce tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176248174" status: 204 len: 0 microversion: 2.20 time: 0.023556 Jul 26 12:56:15.755091 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 307/625] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Jul 26 12:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176248174 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 26 12:56:16.407317 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a236e73c-c3e7-4bd1-b3de-f93ad9dfecb4 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Action: 'create', calling method: .version_select at 0x7f65f5231d30>, body: {"keypair": {"name": "tempest-keypair-1346370454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5LhjhYOMrIHKxO8k4+ZjPqYHW2E1nCCRPMe/3qGgJ1e60e3O1sXbDNXyDLvbHj4iN+7eCSYWLR0xiYB2i+RSstHlmYWdJOfEM+DLj4VjVTbzCzHdteGTkREsACFA77eg=="}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:16.423903 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-a236e73c-c3e7-4bd1-b3de-f93ad9dfecb4 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Getting quotas for project a93dd858fb7a40fbbb679fbe676b1f3c. Resources: {'key_pairs'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:56:16.428210 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-a236e73c-c3e7-4bd1-b3de-f93ad9dfecb4 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Getting quotas for user 17b7e2c1b1b04366b99e9ab892aeb835 and project a93dd858fb7a40fbbb679fbe676b1f3c. Resources: {'key_pairs'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:56:16.450615 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a236e73c-c3e7-4bd1-b3de-f93ad9dfecb4 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047153 Jul 26 12:56:16.451377 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 319/626] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Jul 26 12:56:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 12:56:17.741367 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2140080601", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a8231d6-efdb-4b1f-9ae4-a493641a47ab"}], "security_groups": [{"name": "tempest-securitygroup--1211096303"}], "key_name": "tempest-keypair-1346370454", "user_data": "}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:17.952293 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.network.neutron [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] validate_networks() for [('2a8231d6-efdb-4b1f-9ae4-a493641a47ab', None, None, None, None, None)] {{(pid=129307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:56:18.322096 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Flavor limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:56:18.322524 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Image limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:56:18.323004 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Flavor pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:56:18.323423 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Image pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:56:18.323877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:56:18.332965 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:18.333416 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:18.334257 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:18.334715 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:18.351698 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Getting quotas for project a93dd858fb7a40fbbb679fbe676b1f3c. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:56:18.355665 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Getting quotas for user 17b7e2c1b1b04366b99e9ab892aeb835 and project a93dd858fb7a40fbbb679fbe676b1f3c. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:56:18.367117 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Going to run 1 instances... {{(pid=129307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:56:18.369503 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:56:18.418123 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5b68f3e9-61b7-4e37-be02-349aa8eebfc8 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.682314 Jul 26 12:56:18.418758 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 308/627] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Jul 26 12:56:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 12:56:18.430642 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8fa46713-bf3f-4632-b39b-31635005b639 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:18.431318 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8fa46713-bf3f-4632-b39b-31635005b639 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:18.488706 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8fa46713-bf3f-4632-b39b-31635005b639 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:18.497299 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8fa46713-bf3f-4632-b39b-31635005b639 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:18.498861 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8fa46713-bf3f-4632-b39b-31635005b639 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:18.500003 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8fa46713-bf3f-4632-b39b-31635005b639 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1282 microversion: 2.20 time: 0.074286 Jul 26 12:56:18.500826 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 320/628] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:56:18 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:56:19.523104 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b26f27d9-7ce4-4d08-8dfa-86a108005bba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:19.523757 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b26f27d9-7ce4-4d08-8dfa-86a108005bba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:19.530582 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b26f27d9-7ce4-4d08-8dfa-86a108005bba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:19.531043 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b26f27d9-7ce4-4d08-8dfa-86a108005bba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:19.531859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b26f27d9-7ce4-4d08-8dfa-86a108005bba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:19.532301 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b26f27d9-7ce4-4d08-8dfa-86a108005bba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:19.607006 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b26f27d9-7ce4-4d08-8dfa-86a108005bba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:19.615806 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b26f27d9-7ce4-4d08-8dfa-86a108005bba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:19.617304 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b26f27d9-7ce4-4d08-8dfa-86a108005bba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:19.618412 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b26f27d9-7ce4-4d08-8dfa-86a108005bba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1352 microversion: 2.20 time: 0.099799 Jul 26 12:56:19.618976 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 309/629] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:56:19 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:56:20.641239 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-681361b0-31e2-4faf-8c2e-66877915f656 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:20.641889 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-681361b0-31e2-4faf-8c2e-66877915f656 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:20.648678 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-681361b0-31e2-4faf-8c2e-66877915f656 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:20.649127 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-681361b0-31e2-4faf-8c2e-66877915f656 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:20.649975 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-681361b0-31e2-4faf-8c2e-66877915f656 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:20.650333 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-681361b0-31e2-4faf-8c2e-66877915f656 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:20.790924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-681361b0-31e2-4faf-8c2e-66877915f656 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:20.801586 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-681361b0-31e2-4faf-8c2e-66877915f656 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:20.803743 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-681361b0-31e2-4faf-8c2e-66877915f656 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:20.804864 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-681361b0-31e2-4faf-8c2e-66877915f656 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1408 microversion: 2.20 time: 0.167700 Jul 26 12:56:20.805413 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 321/630] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:56:20 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:56:21.174769 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-f925725e-4766-416d-9d1f-c5dfe2fe8daf req-aaf9095c-96ee-4c8c-aa6a-7b3f115140c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "146eb1e1-e26e-4f91-ad22-2cf7926f8b93", "tag": "542d7fcb-23e0-4cab-98aa-203a4db90c44"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:21.200649 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-f925725e-4766-416d-9d1f-c5dfe2fe8daf req-aaf9095c-96ee-4c8c-aa6a-7b3f115140c2 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:21.201104 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-f925725e-4766-416d-9d1f-c5dfe2fe8daf req-aaf9095c-96ee-4c8c-aa6a-7b3f115140c2 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:21.212895 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-f925725e-4766-416d-9d1f-c5dfe2fe8daf req-aaf9095c-96ee-4c8c-aa6a-7b3f115140c2 service nova] Creating event network-changed:542d7fcb-23e0-4cab-98aa-203a4db90c44 for instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 on hv-cinder-85093 Jul 26 12:56:21.218540 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-f925725e-4766-416d-9d1f-c5dfe2fe8daf req-aaf9095c-96ee-4c8c-aa6a-7b3f115140c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049757 Jul 26 12:56:21.220000 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 310/631] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:56:21.827936 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-17e38841-4414-4889-a737-980740482d3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:21.828548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-17e38841-4414-4889-a737-980740482d3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:21.835572 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-17e38841-4414-4889-a737-980740482d3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:21.836056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-17e38841-4414-4889-a737-980740482d3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:21.836824 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-17e38841-4414-4889-a737-980740482d3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:21.837268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-17e38841-4414-4889-a737-980740482d3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:21.965099 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-17e38841-4414-4889-a737-980740482d3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:21.973165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-17e38841-4414-4889-a737-980740482d3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:21.974677 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-17e38841-4414-4889-a737-980740482d3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:21.975887 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-17e38841-4414-4889-a737-980740482d3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1408 microversion: 2.20 time: 0.151818 Jul 26 12:56:21.976355 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 322/632] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:56:21 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:56:22.999572 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2624c9b5-9bcb-43fb-8a84-f67784e8ec6e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:23.000447 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2624c9b5-9bcb-43fb-8a84-f67784e8ec6e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:23.007130 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2624c9b5-9bcb-43fb-8a84-f67784e8ec6e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:23.007584 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2624c9b5-9bcb-43fb-8a84-f67784e8ec6e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:23.008380 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2624c9b5-9bcb-43fb-8a84-f67784e8ec6e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:23.008817 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2624c9b5-9bcb-43fb-8a84-f67784e8ec6e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:23.149666 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2624c9b5-9bcb-43fb-8a84-f67784e8ec6e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:23.158095 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2624c9b5-9bcb-43fb-8a84-f67784e8ec6e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:23.159608 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2624c9b5-9bcb-43fb-8a84-f67784e8ec6e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:23.160805 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2624c9b5-9bcb-43fb-8a84-f67784e8ec6e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1408 microversion: 2.20 time: 0.167227 Jul 26 12:56:23.161366 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 311/633] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:56:22 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:56:24.184363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3035ed5e-563a-492d-b74c-96b667491e92 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:24.184972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3035ed5e-563a-492d-b74c-96b667491e92 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:24.192047 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3035ed5e-563a-492d-b74c-96b667491e92 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:24.192497 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3035ed5e-563a-492d-b74c-96b667491e92 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:24.193867 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3035ed5e-563a-492d-b74c-96b667491e92 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:24.194467 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3035ed5e-563a-492d-b74c-96b667491e92 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:24.324296 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3035ed5e-563a-492d-b74c-96b667491e92 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:24.332275 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3035ed5e-563a-492d-b74c-96b667491e92 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:24.333907 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3035ed5e-563a-492d-b74c-96b667491e92 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:24.334982 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3035ed5e-563a-492d-b74c-96b667491e92 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1408 microversion: 2.20 time: 0.154608 Jul 26 12:56:24.335542 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 323/634] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:56:24 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:56:25.158532 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-79a2ccc1-5dbe-4bdb-bc8f-e3cba0c35fd5 req-b061624e-2315-4f43-810a-1ae2a2655d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146eb1e1-e26e-4f91-ad22-2cf7926f8b93", "name": "network-vif-plugged", "status": "completed", "tag": "542d7fcb-23e0-4cab-98aa-203a4db90c44"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:25.170563 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-79a2ccc1-5dbe-4bdb-bc8f-e3cba0c35fd5 req-b061624e-2315-4f43-810a-1ae2a2655d80 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:25.171040 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-79a2ccc1-5dbe-4bdb-bc8f-e3cba0c35fd5 req-b061624e-2315-4f43-810a-1ae2a2655d80 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:25.186040 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-79a2ccc1-5dbe-4bdb-bc8f-e3cba0c35fd5 req-b061624e-2315-4f43-810a-1ae2a2655d80 service nova] Creating event network-vif-plugged:542d7fcb-23e0-4cab-98aa-203a4db90c44 for instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 on hv-cinder-85093 Jul 26 12:56:25.190896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-79a2ccc1-5dbe-4bdb-bc8f-e3cba0c35fd5 req-b061624e-2315-4f43-810a-1ae2a2655d80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036050 Jul 26 12:56:25.191713 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 312/635] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:56:25.358448 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-bc3c0bc7-ecca-42f6-980d-eb19b14dcc30 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:25.359093 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-bc3c0bc7-ecca-42f6-980d-eb19b14dcc30 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:25.365936 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bc3c0bc7-ecca-42f6-980d-eb19b14dcc30 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:25.366485 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bc3c0bc7-ecca-42f6-980d-eb19b14dcc30 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:25.367257 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bc3c0bc7-ecca-42f6-980d-eb19b14dcc30 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:25.367718 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bc3c0bc7-ecca-42f6-980d-eb19b14dcc30 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:25.498570 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-bc3c0bc7-ecca-42f6-980d-eb19b14dcc30 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:25.506728 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-bc3c0bc7-ecca-42f6-980d-eb19b14dcc30 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:25.508248 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-bc3c0bc7-ecca-42f6-980d-eb19b14dcc30 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:25.509330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-bc3c0bc7-ecca-42f6-980d-eb19b14dcc30 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1408 microversion: 2.20 time: 0.154912 Jul 26 12:56:25.509885 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 324/636] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:56:25 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:56:26.532891 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2bb3f36f-a4fe-4b88-a19c-e325f2d591de tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:26.533697 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2bb3f36f-a4fe-4b88-a19c-e325f2d591de tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:26.540761 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2bb3f36f-a4fe-4b88-a19c-e325f2d591de tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:26.541212 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2bb3f36f-a4fe-4b88-a19c-e325f2d591de tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:26.541989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2bb3f36f-a4fe-4b88-a19c-e325f2d591de tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:26.542428 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2bb3f36f-a4fe-4b88-a19c-e325f2d591de tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:26.678508 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2bb3f36f-a4fe-4b88-a19c-e325f2d591de tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:26.686476 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2bb3f36f-a4fe-4b88-a19c-e325f2d591de tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:26.688003 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2bb3f36f-a4fe-4b88-a19c-e325f2d591de tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:26.689109 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2bb3f36f-a4fe-4b88-a19c-e325f2d591de tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1408 microversion: 2.20 time: 0.160548 Jul 26 12:56:26.689660 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 313/637] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:56:26 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:56:27.712382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-63b3c000-001a-48ad-8f17-402754353df3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:27.713096 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-63b3c000-001a-48ad-8f17-402754353df3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:27.719570 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-63b3c000-001a-48ad-8f17-402754353df3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:27.720057 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-63b3c000-001a-48ad-8f17-402754353df3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:27.720824 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-63b3c000-001a-48ad-8f17-402754353df3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:27.721260 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-63b3c000-001a-48ad-8f17-402754353df3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:27.858371 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-63b3c000-001a-48ad-8f17-402754353df3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:27.866044 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-63b3c000-001a-48ad-8f17-402754353df3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:27.867524 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-63b3c000-001a-48ad-8f17-402754353df3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:27.868693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-63b3c000-001a-48ad-8f17-402754353df3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1601 microversion: 2.20 time: 0.160767 Jul 26 12:56:27.869227 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 325/638] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:56:27 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:56:27.891220 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f68a7f38-2bce-47fc-aebb-45945125ecf6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:27.891802 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f68a7f38-2bce-47fc-aebb-45945125ecf6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:27.899314 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f68a7f38-2bce-47fc-aebb-45945125ecf6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:27.899868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f68a7f38-2bce-47fc-aebb-45945125ecf6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:27.900643 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f68a7f38-2bce-47fc-aebb-45945125ecf6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:27.901081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f68a7f38-2bce-47fc-aebb-45945125ecf6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:27.985392 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f68a7f38-2bce-47fc-aebb-45945125ecf6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098180 Jul 26 12:56:27.985991 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 314/639] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Jul 26 12:56:27 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 12:56:28.907553 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-0e1ff2ae-5677-4014-bc2d-76a6d4375a62 req-74de49e6-083f-482d-97df-4535dd184b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "146eb1e1-e26e-4f91-ad22-2cf7926f8b93", "tag": "542d7fcb-23e0-4cab-98aa-203a4db90c44"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:28.914762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=6 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:28.920170 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-0e1ff2ae-5677-4014-bc2d-76a6d4375a62 req-74de49e6-083f-482d-97df-4535dd184b4e service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:28.920611 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-0e1ff2ae-5677-4014-bc2d-76a6d4375a62 req-74de49e6-083f-482d-97df-4535dd184b4e service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:28.932240 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-0e1ff2ae-5677-4014-bc2d-76a6d4375a62 req-74de49e6-083f-482d-97df-4535dd184b4e service nova] Creating event network-changed:542d7fcb-23e0-4cab-98aa-203a4db90c44 for instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 on hv-cinder-85093 Jul 26 12:56:28.937524 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-0e1ff2ae-5677-4014-bc2d-76a6d4375a62 req-74de49e6-083f-482d-97df-4535dd184b4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033610 Jul 26 12:56:28.938172 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 326/640] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:56:30.713005 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=2 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:30.713767 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=6 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:30.718248 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9b332cfe-b13d-41a2-9cb8-d71436f8ec3b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:30.718746 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9b332cfe-b13d-41a2-9cb8-d71436f8ec3b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:30.726219 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9b332cfe-b13d-41a2-9cb8-d71436f8ec3b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:30.726681 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9b332cfe-b13d-41a2-9cb8-d71436f8ec3b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:30.727445 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9b332cfe-b13d-41a2-9cb8-d71436f8ec3b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:30.727913 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9b332cfe-b13d-41a2-9cb8-d71436f8ec3b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:30.813457 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-9b332cfe-b13d-41a2-9cb8-d71436f8ec3b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lazy-loading 'services' on Instance uuid cd47bdd7-0e5c-45eb-a6fb-979300251996 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:56:30.886029 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9b332cfe-b13d-41a2-9cb8-d71436f8ec3b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-volume_attachments/2fc334ca-2ead-405a-a4cd-68c5af120a2b" status: 202 len: 0 microversion: 2.1 time: 0.173362 Jul 26 12:56:30.886626 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 315/641] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Jul 26 12:56:30 2022] DELETE /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-volume_attachments/2fc334ca-2ead-405a-a4cd-68c5af120a2b => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:56:30.896757 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-25c0add8-39cb-40e9-bc5d-a190eb7f3721 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:30.899046 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-25c0add8-39cb-40e9-bc5d-a190eb7f3721 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:30.906629 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-25c0add8-39cb-40e9-bc5d-a190eb7f3721 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:30.907081 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-25c0add8-39cb-40e9-bc5d-a190eb7f3721 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:30.907890 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-25c0add8-39cb-40e9-bc5d-a190eb7f3721 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:30.908327 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-25c0add8-39cb-40e9-bc5d-a190eb7f3721 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:30.939904 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-25c0add8-39cb-40e9-bc5d-a190eb7f3721 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048488 Jul 26 12:56:30.940458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 327/642] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:56:30 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:56:31.954123 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-45436d8f-144f-408a-95f2-f487f6d85d1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:31.956458 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-45436d8f-144f-408a-95f2-f487f6d85d1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:31.962808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-45436d8f-144f-408a-95f2-f487f6d85d1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:31.963260 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-45436d8f-144f-408a-95f2-f487f6d85d1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:31.964060 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-45436d8f-144f-408a-95f2-f487f6d85d1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:31.964496 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-45436d8f-144f-408a-95f2-f487f6d85d1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:31.994417 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-45436d8f-144f-408a-95f2-f487f6d85d1a tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045075 Jul 26 12:56:31.994977 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 316/643] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:56:31 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 12:56:32.072019 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-05b5cd5c-9ea7-4b16-babe-ab60a8692953 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:32.072627 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-05b5cd5c-9ea7-4b16-babe-ab60a8692953 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:32.079128 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-05b5cd5c-9ea7-4b16-babe-ab60a8692953 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:32.079513 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-05b5cd5c-9ea7-4b16-babe-ab60a8692953 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:32.080297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-05b5cd5c-9ea7-4b16-babe-ab60a8692953 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:32.080729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-05b5cd5c-9ea7-4b16-babe-ab60a8692953 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:32.106650 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-05b5cd5c-9ea7-4b16-babe-ab60a8692953 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Going to try to terminate instance {{(pid=129308) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:56:32.182935 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-05b5cd5c-9ea7-4b16-babe-ab60a8692953 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 204 len: 0 microversion: 2.1 time: 0.114485 Jul 26 12:56:32.183887 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 328/644] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:56:32 2022] DELETE /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:56:32.192620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-fc544324-4193-4dce-8a97-1966fc86270c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:32.193239 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-fc544324-4193-4dce-8a97-1966fc86270c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:32.199194 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fc544324-4193-4dce-8a97-1966fc86270c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:32.199662 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fc544324-4193-4dce-8a97-1966fc86270c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:32.200449 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fc544324-4193-4dce-8a97-1966fc86270c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:32.200887 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fc544324-4193-4dce-8a97-1966fc86270c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:32.339941 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-fc544324-4193-4dce-8a97-1966fc86270c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:32.347435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-fc544324-4193-4dce-8a97-1966fc86270c tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1686 microversion: 2.1 time: 0.159392 Jul 26 12:56:32.348112 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 317/645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:32 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:56:33.256386 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0147e742-8a1d-4279-839d-8fb5eed2b52e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:33.256961 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0147e742-8a1d-4279-839d-8fb5eed2b52e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:33.263018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0147e742-8a1d-4279-839d-8fb5eed2b52e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:33.263477 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0147e742-8a1d-4279-839d-8fb5eed2b52e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:33.264267 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0147e742-8a1d-4279-839d-8fb5eed2b52e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:33.264697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0147e742-8a1d-4279-839d-8fb5eed2b52e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:33.288084 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0147e742-8a1d-4279-839d-8fb5eed2b52e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/ips" status: 200 len: 150 microversion: 2.1 time: 0.138272 Jul 26 12:56:33.288634 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 329/646] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Jul 26 12:56:33 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/ips => generated 150 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:56:33.369979 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-eda70ae7-66af-4499-9022-e80d4e5c10c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:33.370690 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-eda70ae7-66af-4499-9022-e80d4e5c10c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:33.377274 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eda70ae7-66af-4499-9022-e80d4e5c10c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:33.377800 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eda70ae7-66af-4499-9022-e80d4e5c10c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:33.378892 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eda70ae7-66af-4499-9022-e80d4e5c10c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:33.379331 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eda70ae7-66af-4499-9022-e80d4e5c10c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:33.527900 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-eda70ae7-66af-4499-9022-e80d4e5c10c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:33.538373 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-eda70ae7-66af-4499-9022-e80d4e5c10c5 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1686 microversion: 2.1 time: 0.172119 Jul 26 12:56:33.538950 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 318/647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:33 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:34.559409 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-80fc74e2-35e0-4ee4-95d5-403b7201d795 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:34.560041 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-80fc74e2-35e0-4ee4-95d5-403b7201d795 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:34.566621 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-80fc74e2-35e0-4ee4-95d5-403b7201d795 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:34.567067 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-80fc74e2-35e0-4ee4-95d5-403b7201d795 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:34.567918 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-80fc74e2-35e0-4ee4-95d5-403b7201d795 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:34.568954 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-80fc74e2-35e0-4ee4-95d5-403b7201d795 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:34.624277 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-eb9be7cd-140e-440e-ad67-995103210c19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "194f0468-4650-4f92-b82f-901744c190b5"}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:34.628593 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-eb9be7cd-140e-440e-ad67-995103210c19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:34.640699 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eb9be7cd-140e-440e-ad67-995103210c19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:34.641492 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eb9be7cd-140e-440e-ad67-995103210c19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:34.642629 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eb9be7cd-140e-440e-ad67-995103210c19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:34.643413 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eb9be7cd-140e-440e-ad67-995103210c19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:34.727837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-80fc74e2-35e0-4ee4-95d5-403b7201d795 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:34.735234 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-80fc74e2-35e0-4ee4-95d5-403b7201d795 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1686 microversion: 2.1 time: 0.179666 Jul 26 12:56:34.735837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 330/648] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:34 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:35.545921 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:35.660587 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-eb9be7cd-140e-440e-ad67-995103210c19 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "POST /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.043760 Jul 26 12:56:35.661383 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 319/649] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 12:56:34 2022] POST /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/os-volume_attachments => generated 194 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:56:35.758234 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1be3e9d8-9cf6-4f0d-9344-c94e7efa8687 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:35.759008 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1be3e9d8-9cf6-4f0d-9344-c94e7efa8687 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:35.765442 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1be3e9d8-9cf6-4f0d-9344-c94e7efa8687 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:35.765956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1be3e9d8-9cf6-4f0d-9344-c94e7efa8687 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:35.766783 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1be3e9d8-9cf6-4f0d-9344-c94e7efa8687 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:35.767278 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1be3e9d8-9cf6-4f0d-9344-c94e7efa8687 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:35.906194 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1be3e9d8-9cf6-4f0d-9344-c94e7efa8687 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:35.913972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:35.924698 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1be3e9d8-9cf6-4f0d-9344-c94e7efa8687 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1686 microversion: 2.1 time: 0.171400 Jul 26 12:56:35.925607 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 331/650] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:35 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:36.917830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-502969cf-2b94-4410-9bbc-9ddd85bace1a req-d611631a-8cd0-4fc0-bd7e-87a370fbf35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd47bdd7-0e5c-45eb-a6fb-979300251996", "name": "network-vif-deleted", "tag": "0da5fda1-917d-45ee-bba6-4a249f129d9a"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:36.928584 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-502969cf-2b94-4410-9bbc-9ddd85bace1a req-d611631a-8cd0-4fc0-bd7e-87a370fbf35b service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:36.929027 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-502969cf-2b94-4410-9bbc-9ddd85bace1a req-d611631a-8cd0-4fc0-bd7e-87a370fbf35b service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:36.941408 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-502969cf-2b94-4410-9bbc-9ddd85bace1a req-d611631a-8cd0-4fc0-bd7e-87a370fbf35b service nova] Creating event network-vif-deleted:0da5fda1-917d-45ee-bba6-4a249f129d9a for instance cd47bdd7-0e5c-45eb-a6fb-979300251996 on hv-cinder-85093 Jul 26 12:56:36.947579 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-502969cf-2b94-4410-9bbc-9ddd85bace1a req-d611631a-8cd0-4fc0-bd7e-87a370fbf35b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034120 Jul 26 12:56:36.948459 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 320/651] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:56:36.948786 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6e913e68-6aef-45c2-b8fc-ef315cb42462 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:36.949536 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6e913e68-6aef-45c2-b8fc-ef315cb42462 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:36.957608 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6e913e68-6aef-45c2-b8fc-ef315cb42462 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:36.958065 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6e913e68-6aef-45c2-b8fc-ef315cb42462 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:36.962610 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6e913e68-6aef-45c2-b8fc-ef315cb42462 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:36.963010 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6e913e68-6aef-45c2-b8fc-ef315cb42462 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:37.028907 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6e913e68-6aef-45c2-b8fc-ef315cb42462 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:37.037572 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6e913e68-6aef-45c2-b8fc-ef315cb42462 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 200 len: 1330 microversion: 2.1 time: 0.093659 Jul 26 12:56:37.038140 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 332/652] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:36 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:38.057894 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f650b6d5-8f25-4f8b-88bb-2633700557ff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:38.059196 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f650b6d5-8f25-4f8b-88bb-2633700557ff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: cd47bdd7-0e5c-45eb-a6fb-979300251996] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:38.066617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f650b6d5-8f25-4f8b-88bb-2633700557ff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:38.067079 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f650b6d5-8f25-4f8b-88bb-2633700557ff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:38.068545 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f650b6d5-8f25-4f8b-88bb-2633700557ff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:38.069140 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f650b6d5-8f25-4f8b-88bb-2633700557ff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:38.084612 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-f650b6d5-8f25-4f8b-88bb-2633700557ff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] HTTP exception thrown: Instance cd47bdd7-0e5c-45eb-a6fb-979300251996 could not be found. Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f650b6d5-8f25-4f8b-88bb-2633700557ff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Request method failure captured: Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 HTTP/1.1 Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NLseOU0YmIJgrSP1iVFQKab0I0wnEpm8gTrXCuBzFbpoKQTbc_ctfnrVbevburiE7sm0kD-N0KGIA9K76AJduIP27Sf1Y34WxwJtmrVV5YLgZg5S21dVDnnQMNlaZxrh5vweBHLudYSY3-D1c0nDVQKxHmGjC5iwiZ1_78oFSAOL4 Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: d92bfe73c0a54823a88a89f9ae627134 Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:56:38.086183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:56:38.087728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d92bfe73c0a54823a88a89f9ae627134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d92bfe73c0a54823a88a89f9ae627134", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d92bfe73c0a54823a88a89f9ae627134"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d92bfe73c0a54823a88a89f9ae627134"}]}] Jul 26 12:56:38.087728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:56:38.087728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: d92bfe73c0a54823a88a89f9ae627134 Jul 26 12:56:38.087728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:56:38.087728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-ServerRescueNegativeTestJSON-871230559-project Jul 26 12:56:38.087728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:56:38.087728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:56:38.087728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 2b5894762d4b4cc99521bc224d2bddd7 Jul 26 12:56:38.087728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-ServerRescueNegativeTestJSON-871230559-project Jul 26 12:56:38.087728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:56:38.087728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance cd47bdd7-0e5c-45eb-a6fb-979300251996 could not be found. Jul 26 12:56:38.087728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': 'cd47bdd7-0e5c-45eb-a6fb-979300251996'} Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd47bdd7-0e5c-45eb-a6fb-979300251996 could not be found. Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:56:38.088555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd47bdd7-0e5c-45eb-a6fb-979300251996 could not be found. Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd47bdd7-0e5c-45eb-a6fb-979300251996 could not be found. Jul 26 12:56:38.089797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:38.090905 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f650b6d5-8f25-4f8b-88bb-2633700557ff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Returning 404 to user: Instance cd47bdd7-0e5c-45eb-a6fb-979300251996 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:56:38.090905 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f650b6d5-8f25-4f8b-88bb-2633700557ff tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996" status: 404 len: 111 microversion: 2.1 time: 0.033887 Jul 26 12:56:38.090905 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 321/653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:38 2022] GET /compute/v2.1/servers/cd47bdd7-0e5c-45eb-a6fb-979300251996 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:56:38.096254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3ead88ac-1d17-4baf-8782-f02c9de7bdb8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '.version_select at 0x7f65f535caf0>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:38.115767 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3ead88ac-1d17-4baf-8782-f02c9de7bdb8 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660952901" status: 202 len: 0 microversion: 2.1 time: 0.023130 Jul 26 12:56:38.116243 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 333/654] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Jul 26 12:56:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660952901 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:56:40.990309 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d6c8af71-47fd-445c-8fdd-f1d409317257 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:40.990822 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d6c8af71-47fd-445c-8fdd-f1d409317257 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:40.993323 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:40.998696 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6c8af71-47fd-445c-8fdd-f1d409317257 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:40.999149 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6c8af71-47fd-445c-8fdd-f1d409317257 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:40.999950 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6c8af71-47fd-445c-8fdd-f1d409317257 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:41.000389 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6c8af71-47fd-445c-8fdd-f1d409317257 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:41.028704 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d6c8af71-47fd-445c-8fdd-f1d409317257 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Going to try to terminate instance {{(pid=129307) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:56:41.107348 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d6c8af71-47fd-445c-8fdd-f1d409317257 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 204 len: 0 microversion: 2.1 time: 0.120495 Jul 26 12:56:41.108253 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 322/655] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:56:40 2022] DELETE /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:56:41.116483 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-52639c1e-e359-4e91-9647-ec7e1ce8805b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:41.117093 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-52639c1e-e359-4e91-9647-ec7e1ce8805b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:41.119494 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:41.125962 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-52639c1e-e359-4e91-9647-ec7e1ce8805b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:41.126389 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-52639c1e-e359-4e91-9647-ec7e1ce8805b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:41.127146 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-52639c1e-e359-4e91-9647-ec7e1ce8805b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:41.127579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-52639c1e-e359-4e91-9647-ec7e1ce8805b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:41.256626 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-52639c1e-e359-4e91-9647-ec7e1ce8805b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:41.264498 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-52639c1e-e359-4e91-9647-ec7e1ce8805b tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1506 microversion: 2.1 time: 0.152092 Jul 26 12:56:41.265085 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 334/656] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:41 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:42.286283 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-7417454f-d913-4f90-a25d-7400d99063ab tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:42.287488 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-7417454f-d913-4f90-a25d-7400d99063ab tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:42.294087 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7417454f-d913-4f90-a25d-7400d99063ab tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:42.294488 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7417454f-d913-4f90-a25d-7400d99063ab tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:42.295257 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7417454f-d913-4f90-a25d-7400d99063ab tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:42.295732 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7417454f-d913-4f90-a25d-7400d99063ab tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:42.432724 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-7417454f-d913-4f90-a25d-7400d99063ab tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:42.440171 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-7417454f-d913-4f90-a25d-7400d99063ab tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1506 microversion: 2.1 time: 0.158083 Jul 26 12:56:42.440740 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 323/657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:42 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:43.461366 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6edba95c-83b0-42f6-90a5-4bd5f842bb2d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:43.461973 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6edba95c-83b0-42f6-90a5-4bd5f842bb2d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:43.468223 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6edba95c-83b0-42f6-90a5-4bd5f842bb2d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:43.468673 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6edba95c-83b0-42f6-90a5-4bd5f842bb2d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:43.469433 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6edba95c-83b0-42f6-90a5-4bd5f842bb2d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:43.469868 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6edba95c-83b0-42f6-90a5-4bd5f842bb2d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:43.601638 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6edba95c-83b0-42f6-90a5-4bd5f842bb2d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:43.608953 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6edba95c-83b0-42f6-90a5-4bd5f842bb2d tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1506 microversion: 2.1 time: 0.151526 Jul 26 12:56:43.609512 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 335/658] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:43 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:44.277860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-02477fde-47db-4b78-9384-e8ac7dd87fe1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "194f0468-4650-4f92-b82f-901744c190b5"}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:44.280333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-02477fde-47db-4b78-9384-e8ac7dd87fe1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:44.287284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-02477fde-47db-4b78-9384-e8ac7dd87fe1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:44.287785 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-02477fde-47db-4b78-9384-e8ac7dd87fe1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:44.288545 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-02477fde-47db-4b78-9384-e8ac7dd87fe1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:44.288971 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-02477fde-47db-4b78-9384-e8ac7dd87fe1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:44.368344 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-02477fde-47db-4b78-9384-e8ac7dd87fe1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Invalid volume: volume 194f0468-4650-4f92-b82f-901744c190b5 is already attached to instances: 35776963-2d4e-4698-9ad3-b91a5be95f1c Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-02477fde-47db-4b78-9384-e8ac7dd87fe1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: POST /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/os-volume_attachments HTTP/1.1 Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 74 Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:56:44.370209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:56:44.371940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:56:44.371940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:56:44.371940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:56:44.371940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:56:44.371940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:56:44.371940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:56:44.371940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:56:44.371940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:56:44.371940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:56:44.371940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Jul 26 12:56:44.371940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {"volumeAttachment": {"volumeId": "194f0468-4650-4f92-b82f-901744c190b5"}} Jul 26 12:56:44.371940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Invalid volume: volume 194f0468-4650-4f92-b82f-901744c190b5 is already attached to instances: 35776963-2d4e-4698-9ad3-b91a5be95f1c Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'server_id': '35776963-2d4e-4698-9ad3-b91a5be95f1c', 'body': {'volumeAttachment': {'volumeId': '194f0468-4650-4f92-b82f-901744c190b5'}}} Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 194f0468-4650-4f92-b82f-901744c190b5 is already attached to instances: 35776963-2d4e-4698-9ad3-b91a5be95f1c Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:44.372835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 194f0468-4650-4f92-b82f-901744c190b5 is already attached to instances: 35776963-2d4e-4698-9ad3-b91a5be95f1c Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:44.374264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:56:44.375762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:56:44.375762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:56:44.375762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:56:44.375762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 194f0468-4650-4f92-b82f-901744c190b5 is already attached to instances: 35776963-2d4e-4698-9ad3-b91a5be95f1c Jul 26 12:56:44.375762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:44.375762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-02477fde-47db-4b78-9384-e8ac7dd87fe1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 400 to user: Invalid volume: volume 194f0468-4650-4f92-b82f-901744c190b5 is already attached to instances: 35776963-2d4e-4698-9ad3-b91a5be95f1c {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:56:44.375762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-02477fde-47db-4b78-9384-e8ac7dd87fe1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "POST /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099543 Jul 26 12:56:44.375762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 324/659] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 12:56:44 2022] POST /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 12:56:44.450038 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-4c155b3a-e3ee-481b-ad25-0a7224b8f14e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:44.450592 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-4c155b3a-e3ee-481b-ad25-0a7224b8f14e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:44.466257 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4c155b3a-e3ee-481b-ad25-0a7224b8f14e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:44.466968 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4c155b3a-e3ee-481b-ad25-0a7224b8f14e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:44.467502 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4c155b3a-e3ee-481b-ad25-0a7224b8f14e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:44.467913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4c155b3a-e3ee-481b-ad25-0a7224b8f14e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:44.566229 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-4c155b3a-e3ee-481b-ad25-0a7224b8f14e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lazy-loading 'services' on Instance uuid 35776963-2d4e-4698-9ad3-b91a5be95f1c {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:56:44.592917 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-37d58961-d411-43fc-bc1c-4c30871d3d13 req-e0d63b5b-b89a-4317-b260-085e2bcc64aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b250f71-ee8b-4975-b24b-3984e8b02c6b", "name": "network-vif-deleted", "tag": "fb356747-cdb9-4a2f-9a9d-4f55749ff5fd"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:44.610688 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-37d58961-d411-43fc-bc1c-4c30871d3d13 req-e0d63b5b-b89a-4317-b260-085e2bcc64aa service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:44.611151 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-37d58961-d411-43fc-bc1c-4c30871d3d13 req-e0d63b5b-b89a-4317-b260-085e2bcc64aa service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:44.623585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-37d58961-d411-43fc-bc1c-4c30871d3d13 req-e0d63b5b-b89a-4317-b260-085e2bcc64aa service nova] Creating event network-vif-deleted:fb356747-cdb9-4a2f-9a9d-4f55749ff5fd for instance 2b250f71-ee8b-4975-b24b-3984e8b02c6b on hv-cinder-85093 Jul 26 12:56:44.628718 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-37d58961-d411-43fc-bc1c-4c30871d3d13 req-e0d63b5b-b89a-4317-b260-085e2bcc64aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127712 Jul 26 12:56:44.629537 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 325/660] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:56:44.635848 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-138b80a4-06b5-49dc-a101-588aca9c6aae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:44.636523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-138b80a4-06b5-49dc-a101-588aca9c6aae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:44.643251 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-138b80a4-06b5-49dc-a101-588aca9c6aae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:44.643753 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-138b80a4-06b5-49dc-a101-588aca9c6aae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:44.644781 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-138b80a4-06b5-49dc-a101-588aca9c6aae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:44.645225 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-138b80a4-06b5-49dc-a101-588aca9c6aae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:44.659031 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-4c155b3a-e3ee-481b-ad25-0a7224b8f14e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/os-volume_attachments/194f0468-4650-4f92-b82f-901744c190b5" status: 202 len: 0 microversion: 2.1 time: 0.212713 Jul 26 12:56:44.663480 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 336/661] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Jul 26 12:56:44 2022] DELETE /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/os-volume_attachments/194f0468-4650-4f92-b82f-901744c190b5 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:56:44.669091 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-56049216-57ec-43b6-b29d-f6fe3848e69b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:44.671898 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-56049216-57ec-43b6-b29d-f6fe3848e69b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:44.680783 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-56049216-57ec-43b6-b29d-f6fe3848e69b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:44.681613 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-56049216-57ec-43b6-b29d-f6fe3848e69b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:44.681740 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-138b80a4-06b5-49dc-a101-588aca9c6aae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:44.682199 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-138b80a4-06b5-49dc-a101-588aca9c6aae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:44.682861 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-138b80a4-06b5-49dc-a101-588aca9c6aae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lazy-loading 'fault' on Instance uuid 2b250f71-ee8b-4975-b24b-3984e8b02c6b {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:56:44.683090 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-56049216-57ec-43b6-b29d-f6fe3848e69b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:44.683526 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-56049216-57ec-43b6-b29d-f6fe3848e69b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:44.716960 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-56049216-57ec-43b6-b29d-f6fe3848e69b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051867 Jul 26 12:56:44.717456 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 337/662] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:56:44 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:56:44.730284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-138b80a4-06b5-49dc-a101-588aca9c6aae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:44.738266 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-138b80a4-06b5-49dc-a101-588aca9c6aae tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 200 len: 1311 microversion: 2.1 time: 0.106939 Jul 26 12:56:44.738863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 326/663] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:44 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:45.729047 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-14648bfb-5f8b-4e09-949a-b7ebb2fe8196 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:45.731308 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-14648bfb-5f8b-4e09-949a-b7ebb2fe8196 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:45.737819 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-14648bfb-5f8b-4e09-949a-b7ebb2fe8196 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:45.738271 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-14648bfb-5f8b-4e09-949a-b7ebb2fe8196 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:45.739034 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-14648bfb-5f8b-4e09-949a-b7ebb2fe8196 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:45.739470 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-14648bfb-5f8b-4e09-949a-b7ebb2fe8196 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:45.760011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-85eea3ed-369c-4d95-b1d3-bfa3086ae8dc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:45.760761 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-85eea3ed-369c-4d95-b1d3-bfa3086ae8dc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 2b250f71-ee8b-4975-b24b-3984e8b02c6b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:45.767127 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-85eea3ed-369c-4d95-b1d3-bfa3086ae8dc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:45.767571 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-85eea3ed-369c-4d95-b1d3-bfa3086ae8dc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:45.768371 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-85eea3ed-369c-4d95-b1d3-bfa3086ae8dc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:45.768811 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-85eea3ed-369c-4d95-b1d3-bfa3086ae8dc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:45.771263 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-14648bfb-5f8b-4e09-949a-b7ebb2fe8196 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046110 Jul 26 12:56:45.771866 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 338/664] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:56:45 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 12:56:45.782761 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-85eea3ed-369c-4d95-b1d3-bfa3086ae8dc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] HTTP exception thrown: Instance 2b250f71-ee8b-4975-b24b-3984e8b02c6b could not be found. Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-85eea3ed-369c-4d95-b1d3-bfa3086ae8dc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Request method failure captured: Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b HTTP/1.1 Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NLseOU0YmIJgrSP1iVFQKab0I0wnEpm8gTrXCuBzFbpoKQTbc_ctfnrVbevburiE7sm0kD-N0KGIA9K76AJduIP27Sf1Y34WxwJtmrVV5YLgZg5S21dVDnnQMNlaZxrh5vweBHLudYSY3-D1c0nDVQKxHmGjC5iwiZ1_78oFSAOL4 Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: d92bfe73c0a54823a88a89f9ae627134 Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:56:45.784436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:56:45.786007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d92bfe73c0a54823a88a89f9ae627134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d92bfe73c0a54823a88a89f9ae627134", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d92bfe73c0a54823a88a89f9ae627134"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d92bfe73c0a54823a88a89f9ae627134"}]}] Jul 26 12:56:45.786007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:56:45.786007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: d92bfe73c0a54823a88a89f9ae627134 Jul 26 12:56:45.786007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:56:45.786007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-ServerRescueNegativeTestJSON-871230559-project Jul 26 12:56:45.786007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:56:45.786007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:56:45.786007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 2b5894762d4b4cc99521bc224d2bddd7 Jul 26 12:56:45.786007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-ServerRescueNegativeTestJSON-871230559-project Jul 26 12:56:45.786007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:56:45.786007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 2b250f71-ee8b-4975-b24b-3984e8b02c6b could not be found. Jul 26 12:56:45.786007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '2b250f71-ee8b-4975-b24b-3984e8b02c6b'} Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b250f71-ee8b-4975-b24b-3984e8b02c6b could not be found. Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:56:45.786840 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b250f71-ee8b-4975-b24b-3984e8b02c6b could not be found. Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b250f71-ee8b-4975-b24b-3984e8b02c6b could not be found. Jul 26 12:56:45.788500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:45.790620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-85eea3ed-369c-4d95-b1d3-bfa3086ae8dc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Returning 404 to user: Instance 2b250f71-ee8b-4975-b24b-3984e8b02c6b could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:56:45.790620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-85eea3ed-369c-4d95-b1d3-bfa3086ae8dc tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b" status: 404 len: 111 microversion: 2.1 time: 0.030307 Jul 26 12:56:45.790620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 327/665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:45 2022] GET /compute/v2.1/servers/2b250f71-ee8b-4975-b24b-3984e8b02c6b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 12:56:45.794270 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3c7e1a59-4dbf-4393-90fe-ef1eeae7f9f6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:45.794763 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3c7e1a59-4dbf-4393-90fe-ef1eeae7f9f6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:45.800689 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3c7e1a59-4dbf-4393-90fe-ef1eeae7f9f6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:45.801132 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3c7e1a59-4dbf-4393-90fe-ef1eeae7f9f6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:45.801886 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3c7e1a59-4dbf-4393-90fe-ef1eeae7f9f6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:45.802814 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3c7e1a59-4dbf-4393-90fe-ef1eeae7f9f6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:45.827761 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3c7e1a59-4dbf-4393-90fe-ef1eeae7f9f6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Going to try to terminate instance {{(pid=129308) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:56:45.834506 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e06cb91d-5a55-4a07-b201-9f38b8a31d91 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:45.835009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e06cb91d-5a55-4a07-b201-9f38b8a31d91 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:45.841014 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e06cb91d-5a55-4a07-b201-9f38b8a31d91 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:45.841473 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e06cb91d-5a55-4a07-b201-9f38b8a31d91 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:45.842243 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e06cb91d-5a55-4a07-b201-9f38b8a31d91 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:45.842688 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e06cb91d-5a55-4a07-b201-9f38b8a31d91 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:45.869752 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e06cb91d-5a55-4a07-b201-9f38b8a31d91 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Going to try to terminate instance {{(pid=129307) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:56:45.907389 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3c7e1a59-4dbf-4393-90fe-ef1eeae7f9f6 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 204 len: 0 microversion: 2.1 time: 0.116457 Jul 26 12:56:45.908347 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 339/666] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:56:45 2022] DELETE /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:56:45.918245 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-59bdc3a1-925c-4aa6-9c36-73093a308440 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:45.919041 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-59bdc3a1-925c-4aa6-9c36-73093a308440 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:45.925147 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-59bdc3a1-925c-4aa6-9c36-73093a308440 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:45.925596 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-59bdc3a1-925c-4aa6-9c36-73093a308440 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:45.926368 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-59bdc3a1-925c-4aa6-9c36-73093a308440 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:45.926801 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-59bdc3a1-925c-4aa6-9c36-73093a308440 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:45.953903 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e06cb91d-5a55-4a07-b201-9f38b8a31d91 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 204 len: 0 microversion: 2.1 time: 0.123024 Jul 26 12:56:45.954490 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 328/667] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:56:45 2022] DELETE /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 12:56:45.964010 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2da57edb-92c8-47ba-ba03-a0cfcf30f4f7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:45.964563 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2da57edb-92c8-47ba-ba03-a0cfcf30f4f7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:45.970912 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2da57edb-92c8-47ba-ba03-a0cfcf30f4f7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:45.971355 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2da57edb-92c8-47ba-ba03-a0cfcf30f4f7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:45.972146 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2da57edb-92c8-47ba-ba03-a0cfcf30f4f7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:45.972578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2da57edb-92c8-47ba-ba03-a0cfcf30f4f7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:46.087117 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-59bdc3a1-925c-4aa6-9c36-73093a308440 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:46.094871 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-59bdc3a1-925c-4aa6-9c36-73093a308440 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.181879 Jul 26 12:56:46.095440 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 340/668] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:45 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:46.129471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2da57edb-92c8-47ba-ba03-a0cfcf30f4f7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:46.136979 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2da57edb-92c8-47ba-ba03-a0cfcf30f4f7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1683 microversion: 2.1 time: 0.177546 Jul 26 12:56:46.137534 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 329/669] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:45 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:56:47.116185 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-08a95786-9da6-40ae-8ae0-b869ab58a30f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:47.116801 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-08a95786-9da6-40ae-8ae0-b869ab58a30f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:47.123203 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-08a95786-9da6-40ae-8ae0-b869ab58a30f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:47.123684 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-08a95786-9da6-40ae-8ae0-b869ab58a30f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:47.124460 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-08a95786-9da6-40ae-8ae0-b869ab58a30f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:47.124892 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-08a95786-9da6-40ae-8ae0-b869ab58a30f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:47.158006 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-861c9fb3-4f10-4f9b-8014-59182198ed14 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:47.158630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-861c9fb3-4f10-4f9b-8014-59182198ed14 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:47.165493 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-861c9fb3-4f10-4f9b-8014-59182198ed14 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:47.165944 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-861c9fb3-4f10-4f9b-8014-59182198ed14 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:47.166719 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-861c9fb3-4f10-4f9b-8014-59182198ed14 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:47.167153 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-861c9fb3-4f10-4f9b-8014-59182198ed14 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:47.257671 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-08a95786-9da6-40ae-8ae0-b869ab58a30f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:47.265451 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-08a95786-9da6-40ae-8ae0-b869ab58a30f tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.153687 Jul 26 12:56:47.266050 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 341/670] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:47 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:47.297926 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-861c9fb3-4f10-4f9b-8014-59182198ed14 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:47.306289 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-861c9fb3-4f10-4f9b-8014-59182198ed14 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1683 microversion: 2.1 time: 0.152018 Jul 26 12:56:47.306904 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 330/671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:47 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:56:48.288856 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c0a9d366-dfab-46a2-8109-b16152313085 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:48.289489 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c0a9d366-dfab-46a2-8109-b16152313085 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:48.295475 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c0a9d366-dfab-46a2-8109-b16152313085 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:48.295953 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c0a9d366-dfab-46a2-8109-b16152313085 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:48.296739 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c0a9d366-dfab-46a2-8109-b16152313085 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:48.297175 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c0a9d366-dfab-46a2-8109-b16152313085 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:48.330425 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-81b93455-ff04-4348-835b-19bcbe9079ec tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:48.330956 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-81b93455-ff04-4348-835b-19bcbe9079ec tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:48.337630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-81b93455-ff04-4348-835b-19bcbe9079ec tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:48.338084 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-81b93455-ff04-4348-835b-19bcbe9079ec tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:48.338865 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-81b93455-ff04-4348-835b-19bcbe9079ec tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:48.339364 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-81b93455-ff04-4348-835b-19bcbe9079ec tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:48.425244 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c0a9d366-dfab-46a2-8109-b16152313085 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:48.433311 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c0a9d366-dfab-46a2-8109-b16152313085 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.149545 Jul 26 12:56:48.433884 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 342/672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:48 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:48.472273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-81b93455-ff04-4348-835b-19bcbe9079ec tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:48.480431 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-81b93455-ff04-4348-835b-19bcbe9079ec tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1683 microversion: 2.1 time: 0.153884 Jul 26 12:56:48.481006 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 331/673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:48 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:56:49.454450 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3203d0e6-2b15-4ebe-9571-2359364e7156 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:49.455014 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3203d0e6-2b15-4ebe-9571-2359364e7156 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:49.461984 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3203d0e6-2b15-4ebe-9571-2359364e7156 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:49.462437 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3203d0e6-2b15-4ebe-9571-2359364e7156 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:49.463207 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3203d0e6-2b15-4ebe-9571-2359364e7156 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:49.463769 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3203d0e6-2b15-4ebe-9571-2359364e7156 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:49.502226 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d6f10fd4-7348-48ec-9129-f3f02b964b1f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:49.502839 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d6f10fd4-7348-48ec-9129-f3f02b964b1f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:49.510011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6f10fd4-7348-48ec-9129-f3f02b964b1f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:49.510469 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6f10fd4-7348-48ec-9129-f3f02b964b1f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:49.511438 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6f10fd4-7348-48ec-9129-f3f02b964b1f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:49.511908 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d6f10fd4-7348-48ec-9129-f3f02b964b1f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:49.596980 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3203d0e6-2b15-4ebe-9571-2359364e7156 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:49.605312 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3203d0e6-2b15-4ebe-9571-2359364e7156 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1522 microversion: 2.1 time: 0.154686 Jul 26 12:56:49.605889 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 343/674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:49 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:49.643233 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d6f10fd4-7348-48ec-9129-f3f02b964b1f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:49.651321 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d6f10fd4-7348-48ec-9129-f3f02b964b1f tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1683 microversion: 2.1 time: 0.152905 Jul 26 12:56:49.651919 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 332/675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:49 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:56:50.626390 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-081967e8-2d8c-419a-bb6e-426c0007b58e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:50.627003 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-081967e8-2d8c-419a-bb6e-426c0007b58e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:50.634566 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-081967e8-2d8c-419a-bb6e-426c0007b58e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:50.635357 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-081967e8-2d8c-419a-bb6e-426c0007b58e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:50.636177 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-081967e8-2d8c-419a-bb6e-426c0007b58e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:50.636619 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-081967e8-2d8c-419a-bb6e-426c0007b58e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:50.673698 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-185a88d0-d913-47d0-8473-1951cad75b1d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:50.674551 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-185a88d0-d913-47d0-8473-1951cad75b1d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:50.681650 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-185a88d0-d913-47d0-8473-1951cad75b1d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:50.682378 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-185a88d0-d913-47d0-8473-1951cad75b1d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:50.683146 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-185a88d0-d913-47d0-8473-1951cad75b1d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:50.683576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-185a88d0-d913-47d0-8473-1951cad75b1d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:50.763991 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-081967e8-2d8c-419a-bb6e-426c0007b58e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5894762d4b4cc99521bc224d2bddd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd92bfe73c0a54823a88a89f9ae627134', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:50.773146 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-081967e8-2d8c-419a-bb6e-426c0007b58e tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 200 len: 1480 microversion: 2.1 time: 0.150487 Jul 26 12:56:50.774772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 344/676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:50 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 1480 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:50.831656 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-04fbdd10-2587-4a9a-a2e7-34947bdc34df req-92077aa9-5cbc-4d3c-814e-2710153d6cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a767a6a-b160-4f7d-970f-c45ff5bc1566", "name": "network-vif-deleted", "tag": "34328d9b-7b53-457f-a58d-3371c1433b29"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:50.843293 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-04fbdd10-2587-4a9a-a2e7-34947bdc34df req-92077aa9-5cbc-4d3c-814e-2710153d6cb2 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:50.844041 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-04fbdd10-2587-4a9a-a2e7-34947bdc34df req-92077aa9-5cbc-4d3c-814e-2710153d6cb2 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:50.856888 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-04fbdd10-2587-4a9a-a2e7-34947bdc34df req-92077aa9-5cbc-4d3c-814e-2710153d6cb2 service nova] Creating event network-vif-deleted:34328d9b-7b53-457f-a58d-3371c1433b29 for instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 on hv-cinder-85093 Jul 26 12:56:50.863005 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-04fbdd10-2587-4a9a-a2e7-34947bdc34df req-92077aa9-5cbc-4d3c-814e-2710153d6cb2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035498 Jul 26 12:56:50.863781 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 345/677] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:56:50.905479 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-185a88d0-d913-47d0-8473-1951cad75b1d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:50.914331 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-185a88d0-d913-47d0-8473-1951cad75b1d tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1683 microversion: 2.1 time: 0.244513 Jul 26 12:56:50.932505 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 333/678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:50 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1683 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:51.674060 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-c3e0e57c-361b-493e-88e0-b047c9e8c1b4 req-90355ca1-8422-414e-a70a-5f63f0f98a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35776963-2d4e-4698-9ad3-b91a5be95f1c", "name": "network-vif-deleted", "tag": "73ba4e0a-a6ad-4a34-9132-7824ae016df1"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:51.688983 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-c3e0e57c-361b-493e-88e0-b047c9e8c1b4 req-90355ca1-8422-414e-a70a-5f63f0f98a75 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:51.689675 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-c3e0e57c-361b-493e-88e0-b047c9e8c1b4 req-90355ca1-8422-414e-a70a-5f63f0f98a75 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:51.701820 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-c3e0e57c-361b-493e-88e0-b047c9e8c1b4 req-90355ca1-8422-414e-a70a-5f63f0f98a75 service nova] Creating event network-vif-deleted:73ba4e0a-a6ad-4a34-9132-7824ae016df1 for instance 35776963-2d4e-4698-9ad3-b91a5be95f1c on hv-cinder-85093 Jul 26 12:56:51.707292 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-c3e0e57c-361b-493e-88e0-b047c9e8c1b4 req-90355ca1-8422-414e-a70a-5f63f0f98a75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097586 Jul 26 12:56:51.709063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 346/679] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:56:51.796327 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-a40aee35-2d67-4861-b31c-b92a21ac4b34 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:51.796945 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-a40aee35-2d67-4861-b31c-b92a21ac4b34 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] [instance: 1a767a6a-b160-4f7d-970f-c45ff5bc1566] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:51.804157 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a40aee35-2d67-4861-b31c-b92a21ac4b34 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:51.804901 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a40aee35-2d67-4861-b31c-b92a21ac4b34 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:51.805909 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a40aee35-2d67-4861-b31c-b92a21ac4b34 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:51.806359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a40aee35-2d67-4861-b31c-b92a21ac4b34 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:51.820809 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-a40aee35-2d67-4861-b31c-b92a21ac4b34 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] HTTP exception thrown: Instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 could not be found. Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-a40aee35-2d67-4861-b31c-b92a21ac4b34 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Request method failure captured: Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 HTTP/1.1 Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NLseOU0YmIJgrSP1iVFQKab0I0wnEpm8gTrXCuBzFbpoKQTbc_ctfnrVbevburiE7sm0kD-N0KGIA9K76AJduIP27Sf1Y34WxwJtmrVV5YLgZg5S21dVDnnQMNlaZxrh5vweBHLudYSY3-D1c0nDVQKxHmGjC5iwiZ1_78oFSAOL4 Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: d92bfe73c0a54823a88a89f9ae627134 Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:56:51.822512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:56:51.823830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d92bfe73c0a54823a88a89f9ae627134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d92bfe73c0a54823a88a89f9ae627134", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d92bfe73c0a54823a88a89f9ae627134"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d92bfe73c0a54823a88a89f9ae627134"}]}] Jul 26 12:56:51.823830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:56:51.823830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: d92bfe73c0a54823a88a89f9ae627134 Jul 26 12:56:51.823830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-871230559 Jul 26 12:56:51.823830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-ServerRescueNegativeTestJSON-871230559-project Jul 26 12:56:51.823830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:56:51.823830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:56:51.823830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 2b5894762d4b4cc99521bc224d2bddd7 Jul 26 12:56:51.823830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-ServerRescueNegativeTestJSON-871230559-project Jul 26 12:56:51.823830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:56:51.823830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 could not be found. Jul 26 12:56:51.823830 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '1a767a6a-b160-4f7d-970f-c45ff5bc1566'} Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 could not be found. Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:56:51.824559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 could not be found. Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 could not be found. Jul 26 12:56:51.825708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:51.826863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-a40aee35-2d67-4861-b31c-b92a21ac4b34 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] Returning 404 to user: Instance 1a767a6a-b160-4f7d-970f-c45ff5bc1566 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:56:51.826863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-a40aee35-2d67-4861-b31c-b92a21ac4b34 tempest-ServerRescueNegativeTestJSON-871230559 tempest-ServerRescueNegativeTestJSON-871230559-project] 10.222.0.20 "GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566" status: 404 len: 111 microversion: 2.1 time: 0.031519 Jul 26 12:56:51.828666 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 334/680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:51 2022] GET /compute/v2.1/servers/1a767a6a-b160-4f7d-970f-c45ff5bc1566 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:56:51.941739 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-013b6596-b73b-4b69-a466-eb38315afae2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:51.943305 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-013b6596-b73b-4b69-a466-eb38315afae2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:51.956980 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-013b6596-b73b-4b69-a466-eb38315afae2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:51.957568 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-013b6596-b73b-4b69-a466-eb38315afae2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:51.958906 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-013b6596-b73b-4b69-a466-eb38315afae2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:51.959370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-013b6596-b73b-4b69-a466-eb38315afae2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:51.996409 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-013b6596-b73b-4b69-a466-eb38315afae2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:51.996884 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-013b6596-b73b-4b69-a466-eb38315afae2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:51.997374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-013b6596-b73b-4b69-a466-eb38315afae2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lazy-loading 'fault' on Instance uuid 35776963-2d4e-4698-9ad3-b91a5be95f1c {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:56:52.067432 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-013b6596-b73b-4b69-a466-eb38315afae2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:52.082284 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-013b6596-b73b-4b69-a466-eb38315afae2 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 200 len: 1332 microversion: 2.1 time: 0.144129 Jul 26 12:56:52.084127 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 347/681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:51 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 1332 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:53.109652 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-59622e86-e249-468b-9983-030712158aa7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:53.110278 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-59622e86-e249-468b-9983-030712158aa7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:53.117081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-59622e86-e249-468b-9983-030712158aa7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:53.117471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-59622e86-e249-468b-9983-030712158aa7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:53.118285 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-59622e86-e249-468b-9983-030712158aa7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:53.118723 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-59622e86-e249-468b-9983-030712158aa7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:53.123033 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:53.136504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-59622e86-e249-468b-9983-030712158aa7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-59622e86-e249-468b-9983-030712158aa7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c HTTP/1.1 Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:56:53.138067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:56:53.139471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:56:53.139471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:56:53.139471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:56:53.139471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:56:53.139471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:56:53.139471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:56:53.139471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:56:53.139471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:56:53.139471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:56:53.139471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:56:53.139471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:56:53.139471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '35776963-2d4e-4698-9ad3-b91a5be95f1c'} Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:56:53.143860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:56:53.145440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:56:53.147027 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-59622e86-e249-468b-9983-030712158aa7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 404 to user: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:56:53.147027 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-59622e86-e249-468b-9983-030712158aa7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 404 len: 111 microversion: 2.1 time: 0.033797 Jul 26 12:56:53.147027 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 335/682] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:53 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:56:53.149045 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-777e5e81-877a-471f-a159-12dec5b876c5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '.version_select at 0x7f65f5232040>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:53.177536 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-777e5e81-877a-471f-a159-12dec5b876c5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008185422" status: 202 len: 0 microversion: 2.1 time: 0.032805 Jul 26 12:56:53.178482 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 348/683] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Jul 26 12:56:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2008185422 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:56:53.883772 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4cffffb3-64ad-43f2-b389-79b3785c8408 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Action: 'create', calling method: .version_select at 0x7f65f5282310>, body: {"keypair": {"name": "tempest-keypair-2065845172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZOKRtALdPEf1USF2cec1QuK6fvWxSDYm0ihZ9QyXpG6rNReoRj2kP38bXY2qhb+yp0lt+5QXNstnYXXQtVOE+mWBzxRlNETqShqVXzbd24YB6fBN5NrLeAkf13tfecsQ=="}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:53.903626 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-4cffffb3-64ad-43f2-b389-79b3785c8408 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for project 01fca015df86428b9356df3f127327c2. Resources: {'key_pairs'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:56:53.908261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-4cffffb3-64ad-43f2-b389-79b3785c8408 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for user 1401efb776ab424e8ff4f09eac33d92f and project 01fca015df86428b9356df3f127327c2. Resources: {'key_pairs'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:56:53.932204 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4cffffb3-64ad-43f2-b389-79b3785c8408 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053958 Jul 26 12:56:53.933084 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 336/684] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Jul 26 12:56:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:56:55.938458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-871008364", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "923d9432-be57-465d-9c21-1d0c5b4c37d3"}], "security_groups": [{"name": "tempest-securitygroup--1556019294"}], "key_name": "tempest-keypair-2065845172", "user_data": "}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:56.049654 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.network.neutron [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] validate_networks() for [('923d9432-be57-465d-9c21-1d0c5b4c37d3', None, None, None, None, None)] {{(pid=129308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:56:56.543923 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Flavor limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:56:56.544354 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Image limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:56:56.544861 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Flavor pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:56:56.545274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Image pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:56:56.545723 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:56:56.557384 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:56.558018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:56.559281 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:56.560000 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:56.568139 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:56:56.582773 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for project 01fca015df86428b9356df3f127327c2. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:56:56.587447 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Getting quotas for user 1401efb776ab424e8ff4f09eac33d92f and project 01fca015df86428b9356df3f127327c2. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:56:56.598970 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Going to run 1 instances... {{(pid=129308) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:56:56.601311 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:56:56.648510 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-aeb13a1f-de87-41af-b64a-21db90a5a81b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.714946 Jul 26 12:56:56.649714 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 349/685] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:56:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 12:56:56.662100 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c7f1e269-f34e-4c32-ad33-3284f1eaeb9e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:56.663243 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c7f1e269-f34e-4c32-ad33-3284f1eaeb9e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:56.735860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c7f1e269-f34e-4c32-ad33-3284f1eaeb9e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:56.745415 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c7f1e269-f34e-4c32-ad33-3284f1eaeb9e tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 200 len: 1241 microversion: 2.1 time: 0.088432 Jul 26 12:56:56.745987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 337/686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:56 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:57.770195 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b771237e-3a75-4c0e-8e3e-6142e8dfdb58 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:57.771726 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b771237e-3a75-4c0e-8e3e-6142e8dfdb58 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:57.788152 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b771237e-3a75-4c0e-8e3e-6142e8dfdb58 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:57.788631 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b771237e-3a75-4c0e-8e3e-6142e8dfdb58 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:57.789446 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b771237e-3a75-4c0e-8e3e-6142e8dfdb58 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:57.789887 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b771237e-3a75-4c0e-8e3e-6142e8dfdb58 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:57.892683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-b771237e-3a75-4c0e-8e3e-6142e8dfdb58 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:57.905376 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b771237e-3a75-4c0e-8e3e-6142e8dfdb58 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 200 len: 1301 microversion: 2.1 time: 0.142339 Jul 26 12:56:57.907339 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 350/687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:57 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 1301 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:56:58.931718 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6f7629c5-3f95-4906-b7b6-40b0624b2ece tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:56:58.933272 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-6f7629c5-3f95-4906-b7b6-40b0624b2ece tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:56:58.941263 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6f7629c5-3f95-4906-b7b6-40b0624b2ece tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:58.941973 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6f7629c5-3f95-4906-b7b6-40b0624b2ece tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:58.943021 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6f7629c5-3f95-4906-b7b6-40b0624b2ece tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:58.943800 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6f7629c5-3f95-4906-b7b6-40b0624b2ece tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:59.251996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-6f7629c5-3f95-4906-b7b6-40b0624b2ece tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:56:59.266141 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-6f7629c5-3f95-4906-b7b6-40b0624b2ece tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 200 len: 1367 microversion: 2.1 time: 0.340284 Jul 26 12:56:59.266997 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 338/688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:56:58 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:56:59.470687 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-2bca72aa-8d26-4094-80b9-a0a17adf358a req-1c7890fa-4a38-4d45-bbcc-1ed0e4177a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9e8067-dd21-438b-997e-100b012cd6f0", "tag": "f8c8c0ab-fac0-4f1a-8802-3cb64df470f6"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:56:59.490694 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-2bca72aa-8d26-4094-80b9-a0a17adf358a req-1c7890fa-4a38-4d45-bbcc-1ed0e4177a3b service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:56:59.491888 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-2bca72aa-8d26-4094-80b9-a0a17adf358a req-1c7890fa-4a38-4d45-bbcc-1ed0e4177a3b service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:56:59.506456 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-2bca72aa-8d26-4094-80b9-a0a17adf358a req-1c7890fa-4a38-4d45-bbcc-1ed0e4177a3b service nova] Creating event network-changed:f8c8c0ab-fac0-4f1a-8802-3cb64df470f6 for instance 6b9e8067-dd21-438b-997e-100b012cd6f0 on hv-cinder-85093 Jul 26 12:56:59.523139 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-2bca72aa-8d26-4094-80b9-a0a17adf358a req-1c7890fa-4a38-4d45-bbcc-1ed0e4177a3b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059394 Jul 26 12:56:59.526123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 351/689] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:00.290970 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ece550e1-cb9a-4f2f-b985-8bc9fdd55657 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:00.292534 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ece550e1-cb9a-4f2f-b985-8bc9fdd55657 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:00.300251 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ece550e1-cb9a-4f2f-b985-8bc9fdd55657 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:00.300714 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ece550e1-cb9a-4f2f-b985-8bc9fdd55657 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:00.303900 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ece550e1-cb9a-4f2f-b985-8bc9fdd55657 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:00.304364 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ece550e1-cb9a-4f2f-b985-8bc9fdd55657 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:00.548955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ece550e1-cb9a-4f2f-b985-8bc9fdd55657 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:00.560366 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ece550e1-cb9a-4f2f-b985-8bc9fdd55657 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 200 len: 1367 microversion: 2.1 time: 0.273184 Jul 26 12:57:00.561292 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 339/690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:00 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:01.542774 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-be4bcd33-457f-4da4-9a2a-59fa16a4eb01 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Action: 'create', calling method: .version_select at 0x7f65f5249af0>, body: {"keypair": {"name": "tempest-keypair-1814775866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3SaNUey3mXuQ2VOcUk+G7PLomlED7z//H5FTGe5a+HgcsxLuaEjMyM5UpQYcqlXIBXE6Zr8S8Wxxeq7ji9xi7mi7L1mcAqfAfmW3JMSQYscM8+ECgmJudsz+EXiKNWlQ=="}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:01.558208 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-be4bcd33-457f-4da4-9a2a-59fa16a4eb01 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Getting quotas for project 429715c1b71244bcbbf9f30190d25823. Resources: {'key_pairs'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:57:01.561943 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-be4bcd33-457f-4da4-9a2a-59fa16a4eb01 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Getting quotas for user d480ea8c18634b88b3248a80422aa798 and project 429715c1b71244bcbbf9f30190d25823. Resources: {'key_pairs'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:57:01.584128 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-58d45f37-45a7-43a2-a345-70e849c0fec9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:01.585925 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-58d45f37-45a7-43a2-a345-70e849c0fec9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:01.587423 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-be4bcd33-457f-4da4-9a2a-59fa16a4eb01 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.164707 Jul 26 12:57:01.593953 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 352/691] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Jul 26 12:57:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:01.600747 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-58d45f37-45a7-43a2-a345-70e849c0fec9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:01.601448 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-58d45f37-45a7-43a2-a345-70e849c0fec9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:01.602528 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-58d45f37-45a7-43a2-a345-70e849c0fec9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:01.603135 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-58d45f37-45a7-43a2-a345-70e849c0fec9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:01.798939 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-58d45f37-45a7-43a2-a345-70e849c0fec9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:01.809541 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-58d45f37-45a7-43a2-a345-70e849c0fec9 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 200 len: 1367 microversion: 2.1 time: 0.231516 Jul 26 12:57:01.821170 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 340/692] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:01 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:02.832744 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-41abbff4-6b33-4a92-a9fd-c2f34f1a5e66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:02.834066 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-41abbff4-6b33-4a92-a9fd-c2f34f1a5e66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:02.842855 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-41abbff4-6b33-4a92-a9fd-c2f34f1a5e66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:02.843882 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-41abbff4-6b33-4a92-a9fd-c2f34f1a5e66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:02.844869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-41abbff4-6b33-4a92-a9fd-c2f34f1a5e66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:02.845468 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-41abbff4-6b33-4a92-a9fd-c2f34f1a5e66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:02.990750 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-41abbff4-6b33-4a92-a9fd-c2f34f1a5e66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:02.998797 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-41abbff4-6b33-4a92-a9fd-c2f34f1a5e66 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 200 len: 1367 microversion: 2.1 time: 0.171749 Jul 26 12:57:02.999368 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 353/693] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:02 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:03.012159 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1623879152", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4b606f7-2541-4a19-ae64-86a063826c2e"}], "security_groups": [{"name": "tempest-securitygroup--47339701"}], "key_name": "tempest-keypair-1814775866", "user_data": "}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:03.123807 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.network.neutron [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] validate_networks() for [('a4b606f7-2541-4a19-ae64-86a063826c2e', None, None, None, None, None)] {{(pid=129307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:57:03.405585 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-34d2e5cb-5fcd-4d39-8811-4bd10c5c49bf req-b2284d95-089e-4dd4-a5da-32fe2575569b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9e8067-dd21-438b-997e-100b012cd6f0", "name": "network-vif-plugged", "status": "completed", "tag": "f8c8c0ab-fac0-4f1a-8802-3cb64df470f6"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:03.428370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-34d2e5cb-5fcd-4d39-8811-4bd10c5c49bf req-b2284d95-089e-4dd4-a5da-32fe2575569b service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:03.432360 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-34d2e5cb-5fcd-4d39-8811-4bd10c5c49bf req-b2284d95-089e-4dd4-a5da-32fe2575569b service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:03.449638 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-34d2e5cb-5fcd-4d39-8811-4bd10c5c49bf req-b2284d95-089e-4dd4-a5da-32fe2575569b service nova] Creating event network-vif-plugged:f8c8c0ab-fac0-4f1a-8802-3cb64df470f6 for instance 6b9e8067-dd21-438b-997e-100b012cd6f0 on hv-cinder-85093 Jul 26 12:57:03.454936 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-34d2e5cb-5fcd-4d39-8811-4bd10c5c49bf req-b2284d95-089e-4dd4-a5da-32fe2575569b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140728 Jul 26 12:57:03.455816 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 354/694] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:03.638934 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Flavor limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:57:03.639710 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Image limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:57:03.640306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Flavor pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:57:03.640721 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Image pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:57:03.641139 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:57:03.651311 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:03.652050 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:03.652877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:03.653317 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:03.678083 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Getting quotas for project 429715c1b71244bcbbf9f30190d25823. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:57:03.682637 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Getting quotas for user d480ea8c18634b88b3248a80422aa798 and project 429715c1b71244bcbbf9f30190d25823. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:57:03.693989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Going to run 1 instances... {{(pid=129307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:57:03.696321 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:57:03.744946 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-75693131-0818-4110-b545-83dce41ebe80 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.737006 Jul 26 12:57:03.746003 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 341/695] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:57:03 2022] POST /compute/v2.1/servers => generated 400 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 12:57:03.757964 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-27395696-2602-497a-a736-c59346b3b7e8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:03.758657 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-27395696-2602-497a-a736-c59346b3b7e8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:03.815267 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-27395696-2602-497a-a736-c59346b3b7e8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:03.822511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-27395696-2602-497a-a736-c59346b3b7e8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1238 microversion: 2.1 time: 0.069108 Jul 26 12:57:03.823153 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 355/696] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:03 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:04.021489 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-95ea012f-8744-4683-a515-a4ef7bacbee6 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:04.022757 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-95ea012f-8744-4683-a515-a4ef7bacbee6 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:04.033410 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-95ea012f-8744-4683-a515-a4ef7bacbee6 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:04.034279 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-95ea012f-8744-4683-a515-a4ef7bacbee6 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:04.035328 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-95ea012f-8744-4683-a515-a4ef7bacbee6 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:04.036181 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-95ea012f-8744-4683-a515-a4ef7bacbee6 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:04.177059 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-95ea012f-8744-4683-a515-a4ef7bacbee6 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:04.185060 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-95ea012f-8744-4683-a515-a4ef7bacbee6 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 200 len: 1367 microversion: 2.1 time: 0.168027 Jul 26 12:57:04.185651 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 342/697] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:04 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:04.844862 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8d0e1eba-1e9c-4855-9b82-0696be698a86 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:04.845610 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8d0e1eba-1e9c-4855-9b82-0696be698a86 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:04.860863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8d0e1eba-1e9c-4855-9b82-0696be698a86 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:04.861325 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8d0e1eba-1e9c-4855-9b82-0696be698a86 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:04.862700 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8d0e1eba-1e9c-4855-9b82-0696be698a86 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:04.862700 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8d0e1eba-1e9c-4855-9b82-0696be698a86 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:04.948777 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8d0e1eba-1e9c-4855-9b82-0696be698a86 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:04.956844 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8d0e1eba-1e9c-4855-9b82-0696be698a86 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1290 microversion: 2.1 time: 0.116503 Jul 26 12:57:04.957995 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 356/698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:04 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1290 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:05.064507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3edfa7cf-2993-440c-8cd7-fc2c7433c4bb tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:05.065105 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3edfa7cf-2993-440c-8cd7-fc2c7433c4bb tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:05.071999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3edfa7cf-2993-440c-8cd7-fc2c7433c4bb tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:05.072440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3edfa7cf-2993-440c-8cd7-fc2c7433c4bb tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:05.073210 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3edfa7cf-2993-440c-8cd7-fc2c7433c4bb tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:05.073649 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3edfa7cf-2993-440c-8cd7-fc2c7433c4bb tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:05.099570 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3edfa7cf-2993-440c-8cd7-fc2c7433c4bb tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/ips" status: 200 len: 153 microversion: 2.20 time: 0.170619 Jul 26 12:57:05.100194 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 343/699] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Jul 26 12:57:04 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/ips => generated 153 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 12:57:05.206739 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-da44ad88-08ce-4217-95ff-e9f512bd2ead tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:05.207355 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-da44ad88-08ce-4217-95ff-e9f512bd2ead tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:05.213354 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-da44ad88-08ce-4217-95ff-e9f512bd2ead tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:05.213807 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-da44ad88-08ce-4217-95ff-e9f512bd2ead tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:05.214577 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-da44ad88-08ce-4217-95ff-e9f512bd2ead tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:05.215067 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-da44ad88-08ce-4217-95ff-e9f512bd2ead tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:05.430118 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-da44ad88-08ce-4217-95ff-e9f512bd2ead tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:05.445628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-da44ad88-08ce-4217-95ff-e9f512bd2ead tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 200 len: 1557 microversion: 2.1 time: 0.242611 Jul 26 12:57:05.447461 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 357/700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:05 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 1557 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:05.466803 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9f5a418a-dbcc-4fd9-a93d-e982133ebf42 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:05.467295 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9f5a418a-dbcc-4fd9-a93d-e982133ebf42 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:05.487152 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9f5a418a-dbcc-4fd9-a93d-e982133ebf42 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:05.488003 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9f5a418a-dbcc-4fd9-a93d-e982133ebf42 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:05.489038 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9f5a418a-dbcc-4fd9-a93d-e982133ebf42 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:05.490195 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9f5a418a-dbcc-4fd9-a93d-e982133ebf42 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:05.619853 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9f5a418a-dbcc-4fd9-a93d-e982133ebf42 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156820 Jul 26 12:57:05.620769 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 344/701] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Jul 26 12:57:05 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:05.979801 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3965cce4-aab9-41f2-adbf-da4cb8396cf6 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:05.980415 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3965cce4-aab9-41f2-adbf-da4cb8396cf6 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:05.989654 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3965cce4-aab9-41f2-adbf-da4cb8396cf6 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:05.990493 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3965cce4-aab9-41f2-adbf-da4cb8396cf6 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:05.992368 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3965cce4-aab9-41f2-adbf-da4cb8396cf6 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:05.993124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3965cce4-aab9-41f2-adbf-da4cb8396cf6 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:06.091957 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3965cce4-aab9-41f2-adbf-da4cb8396cf6 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:06.104279 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3965cce4-aab9-41f2-adbf-da4cb8396cf6 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1296 microversion: 2.1 time: 0.127712 Jul 26 12:57:06.105198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 358/702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:05 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1296 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:07.023527 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-04316af1-acfe-4067-9318-bc21689b74aa req-56f00cef-0a0c-44fb-8e41-9dc09d7103cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b9e8067-dd21-438b-997e-100b012cd6f0", "tag": "f8c8c0ab-fac0-4f1a-8802-3cb64df470f6"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:07.035760 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-04316af1-acfe-4067-9318-bc21689b74aa req-56f00cef-0a0c-44fb-8e41-9dc09d7103cb service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:07.036482 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-04316af1-acfe-4067-9318-bc21689b74aa req-56f00cef-0a0c-44fb-8e41-9dc09d7103cb service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:07.053538 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-04316af1-acfe-4067-9318-bc21689b74aa req-56f00cef-0a0c-44fb-8e41-9dc09d7103cb service nova] Creating event network-changed:f8c8c0ab-fac0-4f1a-8802-3cb64df470f6 for instance 6b9e8067-dd21-438b-997e-100b012cd6f0 on hv-cinder-85093 Jul 26 12:57:07.058966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-04316af1-acfe-4067-9318-bc21689b74aa req-56f00cef-0a0c-44fb-8e41-9dc09d7103cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041719 Jul 26 12:57:07.060576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 345/703] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:07.141630 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-46b5cf26-1733-4198-a082-d4fad3d2db40 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:07.152464 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-758b04bb-7a87-4c03-bbd9-d5e05f2b9a27 req-40233efe-e586-40be-bcda-a86decd5c083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a1a3713-8bde-42c4-ad34-76974193ab34", "tag": "d45328ab-0a5d-4356-ac91-b30351ad1eea"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:07.157471 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-46b5cf26-1733-4198-a082-d4fad3d2db40 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:07.175518 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:07.194004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-46b5cf26-1733-4198-a082-d4fad3d2db40 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:07.197019 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-46b5cf26-1733-4198-a082-d4fad3d2db40 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:07.201028 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-46b5cf26-1733-4198-a082-d4fad3d2db40 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:07.201793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-46b5cf26-1733-4198-a082-d4fad3d2db40 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:07.203465 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-758b04bb-7a87-4c03-bbd9-d5e05f2b9a27 req-40233efe-e586-40be-bcda-a86decd5c083 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:07.204185 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-758b04bb-7a87-4c03-bbd9-d5e05f2b9a27 req-40233efe-e586-40be-bcda-a86decd5c083 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:07.230881 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-758b04bb-7a87-4c03-bbd9-d5e05f2b9a27 req-40233efe-e586-40be-bcda-a86decd5c083 service nova] Creating event network-changed:d45328ab-0a5d-4356-ac91-b30351ad1eea for instance 5a1a3713-8bde-42c4-ad34-76974193ab34 on hv-cinder-85093 Jul 26 12:57:07.242745 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-758b04bb-7a87-4c03-bbd9-d5e05f2b9a27 req-40233efe-e586-40be-bcda-a86decd5c083 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117819 Jul 26 12:57:07.245347 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 346/704] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:07.343845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-096b9eb9-b836-4813-8b8b-3c171af7f800 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:07.344480 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-096b9eb9-b836-4813-8b8b-3c171af7f800 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:07.357980 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-096b9eb9-b836-4813-8b8b-3c171af7f800 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:07.358520 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-096b9eb9-b836-4813-8b8b-3c171af7f800 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:07.359589 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-096b9eb9-b836-4813-8b8b-3c171af7f800 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:07.360204 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-096b9eb9-b836-4813-8b8b-3c171af7f800 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:07.414539 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-096b9eb9-b836-4813-8b8b-3c171af7f800 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lazy-loading 'flavor' on Instance uuid 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:57:07.591744 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-46b5cf26-1733-4198-a082-d4fad3d2db40 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:07.606458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-46b5cf26-1733-4198-a082-d4fad3d2db40 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1362 microversion: 2.1 time: 0.484697 Jul 26 12:57:07.620127 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 359/705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:07 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1362 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:07.654650 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-096b9eb9-b836-4813-8b8b-3c171af7f800 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "POST /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/action" status: 202 len: 0 microversion: 2.20 time: 0.314816 Jul 26 12:57:07.656045 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 347/706] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Jul 26 12:57:07 2022] POST /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 12:57:07.671758 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-05e6ba9d-5325-47b7-acaa-56b4367627e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:07.672416 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-05e6ba9d-5325-47b7-acaa-56b4367627e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:07.687776 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-05e6ba9d-5325-47b7-acaa-56b4367627e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:07.693380 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-05e6ba9d-5325-47b7-acaa-56b4367627e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:07.694501 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-05e6ba9d-5325-47b7-acaa-56b4367627e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:07.695116 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-05e6ba9d-5325-47b7-acaa-56b4367627e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:07.873116 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-05e6ba9d-5325-47b7-acaa-56b4367627e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:07.882109 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-05e6ba9d-5325-47b7-acaa-56b4367627e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:07.883980 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-05e6ba9d-5325-47b7-acaa-56b4367627e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:07.885423 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-05e6ba9d-5325-47b7-acaa-56b4367627e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.222484 Jul 26 12:57:07.886122 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 360/707] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:07 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:08.630505 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4b07cbfd-e6b3-41c0-8421-3322e8b770e3 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:08.631150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4b07cbfd-e6b3-41c0-8421-3322e8b770e3 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:08.637529 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4b07cbfd-e6b3-41c0-8421-3322e8b770e3 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:08.637973 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4b07cbfd-e6b3-41c0-8421-3322e8b770e3 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:08.638735 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4b07cbfd-e6b3-41c0-8421-3322e8b770e3 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:08.639165 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4b07cbfd-e6b3-41c0-8421-3322e8b770e3 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:08.774964 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4b07cbfd-e6b3-41c0-8421-3322e8b770e3 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:08.782988 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4b07cbfd-e6b3-41c0-8421-3322e8b770e3 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1362 microversion: 2.1 time: 0.157943 Jul 26 12:57:08.783842 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 348/708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:08 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:08.909691 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-26fa6e8c-a68f-4fed-a137-210f2461a3aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:08.910258 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-26fa6e8c-a68f-4fed-a137-210f2461a3aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:08.916937 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-26fa6e8c-a68f-4fed-a137-210f2461a3aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:08.917391 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-26fa6e8c-a68f-4fed-a137-210f2461a3aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:08.918177 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-26fa6e8c-a68f-4fed-a137-210f2461a3aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:08.918623 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-26fa6e8c-a68f-4fed-a137-210f2461a3aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:09.226325 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-26fa6e8c-a68f-4fed-a137-210f2461a3aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:09.234770 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-26fa6e8c-a68f-4fed-a137-210f2461a3aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:09.236309 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-26fa6e8c-a68f-4fed-a137-210f2461a3aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:09.237482 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-26fa6e8c-a68f-4fed-a137-210f2461a3aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.331818 Jul 26 12:57:09.238040 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 361/709] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:08 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:09.804028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-47324f7c-bcd2-44fa-ad0a-595afea11125 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:09.804643 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-47324f7c-bcd2-44fa-ad0a-595afea11125 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:09.811274 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-47324f7c-bcd2-44fa-ad0a-595afea11125 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:09.811761 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-47324f7c-bcd2-44fa-ad0a-595afea11125 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:09.812536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-47324f7c-bcd2-44fa-ad0a-595afea11125 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:09.813012 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-47324f7c-bcd2-44fa-ad0a-595afea11125 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:09.955759 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-47324f7c-bcd2-44fa-ad0a-595afea11125 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:09.963695 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-47324f7c-bcd2-44fa-ad0a-595afea11125 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1362 microversion: 2.1 time: 0.163599 Jul 26 12:57:09.964267 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 349/710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:09 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:10.261941 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1def3535-a4f2-4cb8-949a-8f46fef71fcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:10.262528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1def3535-a4f2-4cb8-949a-8f46fef71fcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:10.269086 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1def3535-a4f2-4cb8-949a-8f46fef71fcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:10.269535 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1def3535-a4f2-4cb8-949a-8f46fef71fcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:10.270302 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1def3535-a4f2-4cb8-949a-8f46fef71fcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:10.271314 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1def3535-a4f2-4cb8-949a-8f46fef71fcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:10.401957 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1def3535-a4f2-4cb8-949a-8f46fef71fcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:10.410344 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1def3535-a4f2-4cb8-949a-8f46fef71fcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:10.412053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1def3535-a4f2-4cb8-949a-8f46fef71fcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:10.413343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1def3535-a4f2-4cb8-949a-8f46fef71fcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.155273 Jul 26 12:57:10.413903 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 362/711] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:10 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:10.985982 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f229bc8a-9c5c-4662-885d-bac889a0bab4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:10.986707 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f229bc8a-9c5c-4662-885d-bac889a0bab4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:10.994703 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f229bc8a-9c5c-4662-885d-bac889a0bab4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:10.995199 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f229bc8a-9c5c-4662-885d-bac889a0bab4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:10.996010 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f229bc8a-9c5c-4662-885d-bac889a0bab4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:10.996454 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f229bc8a-9c5c-4662-885d-bac889a0bab4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:11.137599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f229bc8a-9c5c-4662-885d-bac889a0bab4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:11.145825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f229bc8a-9c5c-4662-885d-bac889a0bab4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1362 microversion: 2.1 time: 0.165280 Jul 26 12:57:11.146441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 350/712] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:10 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:11.326075 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-1de6b757-45bd-4dc4-a00b-bd371262ed0e req-814c4992-4dba-4733-b79b-f3bae94e08a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a1a3713-8bde-42c4-ad34-76974193ab34", "name": "network-vif-plugged", "status": "completed", "tag": "d45328ab-0a5d-4356-ac91-b30351ad1eea"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:11.332252 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:11.342402 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-1de6b757-45bd-4dc4-a00b-bd371262ed0e req-814c4992-4dba-4733-b79b-f3bae94e08a1 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:11.342935 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-1de6b757-45bd-4dc4-a00b-bd371262ed0e req-814c4992-4dba-4733-b79b-f3bae94e08a1 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:11.356566 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-1de6b757-45bd-4dc4-a00b-bd371262ed0e req-814c4992-4dba-4733-b79b-f3bae94e08a1 service nova] Creating event network-vif-plugged:d45328ab-0a5d-4356-ac91-b30351ad1eea for instance 5a1a3713-8bde-42c4-ad34-76974193ab34 on hv-cinder-85093 Jul 26 12:57:11.361883 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-1de6b757-45bd-4dc4-a00b-bd371262ed0e req-814c4992-4dba-4733-b79b-f3bae94e08a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040707 Jul 26 12:57:11.362346 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 363/713] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:57:11.438591 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-00d83ec4-0d40-4739-b6af-9185534799a6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:11.439208 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-00d83ec4-0d40-4739-b6af-9185534799a6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:11.441223 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:11.448270 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-00d83ec4-0d40-4739-b6af-9185534799a6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:11.448725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-00d83ec4-0d40-4739-b6af-9185534799a6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:11.449505 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-00d83ec4-0d40-4739-b6af-9185534799a6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:11.449941 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-00d83ec4-0d40-4739-b6af-9185534799a6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:11.606782 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-00d83ec4-0d40-4739-b6af-9185534799a6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:11.616518 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-00d83ec4-0d40-4739-b6af-9185534799a6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:11.618035 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-00d83ec4-0d40-4739-b6af-9185534799a6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:11.619237 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-00d83ec4-0d40-4739-b6af-9185534799a6 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.186249 Jul 26 12:57:11.619827 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 351/714] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:11 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:12.170452 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7b283997-fd17-4d17-887b-242e278b6022 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:12.171147 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7b283997-fd17-4d17-887b-242e278b6022 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:12.178802 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7b283997-fd17-4d17-887b-242e278b6022 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:12.179257 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7b283997-fd17-4d17-887b-242e278b6022 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:12.180061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7b283997-fd17-4d17-887b-242e278b6022 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:12.180502 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7b283997-fd17-4d17-887b-242e278b6022 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:12.310436 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7b283997-fd17-4d17-887b-242e278b6022 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:12.323706 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7b283997-fd17-4d17-887b-242e278b6022 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1362 microversion: 2.1 time: 0.157729 Jul 26 12:57:12.324330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 364/715] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:12 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:12.642473 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ebbf5f47-a93b-47d1-9ab8-89b5fd6ae131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:12.643783 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ebbf5f47-a93b-47d1-9ab8-89b5fd6ae131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:12.651093 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ebbf5f47-a93b-47d1-9ab8-89b5fd6ae131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:12.651551 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ebbf5f47-a93b-47d1-9ab8-89b5fd6ae131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:12.652530 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ebbf5f47-a93b-47d1-9ab8-89b5fd6ae131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:12.652976 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ebbf5f47-a93b-47d1-9ab8-89b5fd6ae131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:12.784644 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ebbf5f47-a93b-47d1-9ab8-89b5fd6ae131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:12.793161 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ebbf5f47-a93b-47d1-9ab8-89b5fd6ae131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:12.794676 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ebbf5f47-a93b-47d1-9ab8-89b5fd6ae131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:12.795866 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ebbf5f47-a93b-47d1-9ab8-89b5fd6ae131 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.157268 Jul 26 12:57:12.796425 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 352/716] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:12 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:13.344474 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7c767a31-8a76-4e34-8051-9e9646eb56e5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:13.345081 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7c767a31-8a76-4e34-8051-9e9646eb56e5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:13.351600 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c767a31-8a76-4e34-8051-9e9646eb56e5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:13.352089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c767a31-8a76-4e34-8051-9e9646eb56e5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:13.352849 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c767a31-8a76-4e34-8051-9e9646eb56e5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:13.353284 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c767a31-8a76-4e34-8051-9e9646eb56e5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:13.483593 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7c767a31-8a76-4e34-8051-9e9646eb56e5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:13.491456 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7c767a31-8a76-4e34-8051-9e9646eb56e5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1547 microversion: 2.1 time: 0.150874 Jul 26 12:57:13.492064 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 365/717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:13 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:13.512750 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c5622d69-253c-49f7-b47f-0f4f95467a93 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:13.513246 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c5622d69-253c-49f7-b47f-0f4f95467a93 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:13.519221 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c5622d69-253c-49f7-b47f-0f4f95467a93 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:13.519711 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c5622d69-253c-49f7-b47f-0f4f95467a93 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:13.520519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c5622d69-253c-49f7-b47f-0f4f95467a93 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:13.520955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c5622d69-253c-49f7-b47f-0f4f95467a93 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:13.601925 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c5622d69-253c-49f7-b47f-0f4f95467a93 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092935 Jul 26 12:57:13.602553 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 353/718] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Jul 26 12:57:13 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:13.818500 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-dfa696e3-5700-4521-9602-87130ac13e3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:13.819109 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-dfa696e3-5700-4521-9602-87130ac13e3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:13.821079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=12 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:13.826458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dfa696e3-5700-4521-9602-87130ac13e3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:13.826913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dfa696e3-5700-4521-9602-87130ac13e3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:13.827771 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dfa696e3-5700-4521-9602-87130ac13e3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:13.828211 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dfa696e3-5700-4521-9602-87130ac13e3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:13.959313 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-dfa696e3-5700-4521-9602-87130ac13e3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:13.967486 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-dfa696e3-5700-4521-9602-87130ac13e3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:13.968951 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-dfa696e3-5700-4521-9602-87130ac13e3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:13.970097 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-dfa696e3-5700-4521-9602-87130ac13e3e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.155578 Jul 26 12:57:13.970658 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 366/719] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:13 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:14.542029 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=2 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:14.543377 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=12 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:14.547426 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-4033a3d9-f623-45bc-a314-61ae381f2942 req-2d35f3bb-b77e-4e11-aa53-2ca693901cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a1a3713-8bde-42c4-ad34-76974193ab34", "tag": "d45328ab-0a5d-4356-ac91-b30351ad1eea"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:14.557873 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-4033a3d9-f623-45bc-a314-61ae381f2942 req-2d35f3bb-b77e-4e11-aa53-2ca693901cfa service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:14.558321 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-4033a3d9-f623-45bc-a314-61ae381f2942 req-2d35f3bb-b77e-4e11-aa53-2ca693901cfa service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:14.569979 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-4033a3d9-f623-45bc-a314-61ae381f2942 req-2d35f3bb-b77e-4e11-aa53-2ca693901cfa service nova] Creating event network-changed:d45328ab-0a5d-4356-ac91-b30351ad1eea for instance 5a1a3713-8bde-42c4-ad34-76974193ab34 on hv-cinder-85093 Jul 26 12:57:14.575066 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-4033a3d9-f623-45bc-a314-61ae381f2942 req-2d35f3bb-b77e-4e11-aa53-2ca693901cfa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034015 Jul 26 12:57:14.575866 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 354/720] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:14.994005 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-092656f6-bc96-4a67-956f-eae2169cdd3c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:14.994621 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-092656f6-bc96-4a67-956f-eae2169cdd3c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:15.001755 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-092656f6-bc96-4a67-956f-eae2169cdd3c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:15.002436 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-092656f6-bc96-4a67-956f-eae2169cdd3c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:15.003273 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-092656f6-bc96-4a67-956f-eae2169cdd3c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:15.003696 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-092656f6-bc96-4a67-956f-eae2169cdd3c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:15.219209 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-092656f6-bc96-4a67-956f-eae2169cdd3c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:15.232885 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-092656f6-bc96-4a67-956f-eae2169cdd3c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:15.234645 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-092656f6-bc96-4a67-956f-eae2169cdd3c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:15.236005 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-092656f6-bc96-4a67-956f-eae2169cdd3c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.245800 Jul 26 12:57:15.242346 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 367/721] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:14 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:16.263040 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-21ee2634-48e2-4480-8e7c-8cc555c35efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:16.263771 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-21ee2634-48e2-4480-8e7c-8cc555c35efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:16.272235 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-21ee2634-48e2-4480-8e7c-8cc555c35efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:16.272690 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-21ee2634-48e2-4480-8e7c-8cc555c35efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:16.273459 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-21ee2634-48e2-4480-8e7c-8cc555c35efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:16.273894 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-21ee2634-48e2-4480-8e7c-8cc555c35efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:16.407799 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-21ee2634-48e2-4480-8e7c-8cc555c35efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:16.415759 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-21ee2634-48e2-4480-8e7c-8cc555c35efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:16.417428 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-21ee2634-48e2-4480-8e7c-8cc555c35efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:16.418587 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-21ee2634-48e2-4480-8e7c-8cc555c35efa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.160087 Jul 26 12:57:16.419143 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 355/722] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:16 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:17.441965 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7ab7383f-46fc-4aef-8e39-4781b5ba2039 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:17.443126 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7ab7383f-46fc-4aef-8e39-4781b5ba2039 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:17.449765 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ab7383f-46fc-4aef-8e39-4781b5ba2039 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:17.450215 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ab7383f-46fc-4aef-8e39-4781b5ba2039 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:17.450982 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ab7383f-46fc-4aef-8e39-4781b5ba2039 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:17.451424 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ab7383f-46fc-4aef-8e39-4781b5ba2039 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:17.578475 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7ab7383f-46fc-4aef-8e39-4781b5ba2039 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:17.587099 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7ab7383f-46fc-4aef-8e39-4781b5ba2039 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:17.588645 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7ab7383f-46fc-4aef-8e39-4781b5ba2039 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:17.589835 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7ab7383f-46fc-4aef-8e39-4781b5ba2039 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.151888 Jul 26 12:57:17.590397 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 368/723] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:17 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:18.612552 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-51602626-4df4-40b0-a007-0484e5ec5967 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:18.613149 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-51602626-4df4-40b0-a007-0484e5ec5967 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:18.619946 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-51602626-4df4-40b0-a007-0484e5ec5967 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:18.620400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-51602626-4df4-40b0-a007-0484e5ec5967 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:18.621150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-51602626-4df4-40b0-a007-0484e5ec5967 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:18.621579 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-51602626-4df4-40b0-a007-0484e5ec5967 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:18.625635 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:18.763102 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-51602626-4df4-40b0-a007-0484e5ec5967 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:18.770912 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-51602626-4df4-40b0-a007-0484e5ec5967 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:18.772940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-51602626-4df4-40b0-a007-0484e5ec5967 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:18.774089 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-51602626-4df4-40b0-a007-0484e5ec5967 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.165440 Jul 26 12:57:18.774642 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 356/724] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:18 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:19.797375 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-bb5715de-32a9-404c-929f-955d93e1aa4e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:19.797967 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-bb5715de-32a9-404c-929f-955d93e1aa4e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:19.804454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bb5715de-32a9-404c-929f-955d93e1aa4e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:19.804912 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bb5715de-32a9-404c-929f-955d93e1aa4e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:19.805672 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bb5715de-32a9-404c-929f-955d93e1aa4e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:19.806104 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bb5715de-32a9-404c-929f-955d93e1aa4e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:19.937525 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-bb5715de-32a9-404c-929f-955d93e1aa4e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:19.945917 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-bb5715de-32a9-404c-929f-955d93e1aa4e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:19.947428 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-bb5715de-32a9-404c-929f-955d93e1aa4e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:19.948607 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-bb5715de-32a9-404c-929f-955d93e1aa4e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.155175 Jul 26 12:57:19.949174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 369/725] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:19 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:20.972174 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-861edac0-49c4-4c97-9711-339c4f9332d7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:20.972780 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-861edac0-49c4-4c97-9711-339c4f9332d7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:20.980142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-861edac0-49c4-4c97-9711-339c4f9332d7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:20.980603 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-861edac0-49c4-4c97-9711-339c4f9332d7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:20.981374 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-861edac0-49c4-4c97-9711-339c4f9332d7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:20.981817 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-861edac0-49c4-4c97-9711-339c4f9332d7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:21.111189 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-861edac0-49c4-4c97-9711-339c4f9332d7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:21.119582 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-861edac0-49c4-4c97-9711-339c4f9332d7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:21.121115 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-861edac0-49c4-4c97-9711-339c4f9332d7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:21.122281 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-861edac0-49c4-4c97-9711-339c4f9332d7 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.154039 Jul 26 12:57:21.122836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 357/726] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:20 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:22.145343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-957ac223-eb2a-4465-83e7-5eea24c8bb4a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:22.146683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-957ac223-eb2a-4465-83e7-5eea24c8bb4a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:22.153315 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-957ac223-eb2a-4465-83e7-5eea24c8bb4a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:22.153771 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-957ac223-eb2a-4465-83e7-5eea24c8bb4a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:22.154605 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-957ac223-eb2a-4465-83e7-5eea24c8bb4a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:22.154967 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-957ac223-eb2a-4465-83e7-5eea24c8bb4a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:22.173854 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=100 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:22.290508 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-957ac223-eb2a-4465-83e7-5eea24c8bb4a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:22.301585 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-957ac223-eb2a-4465-83e7-5eea24c8bb4a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:22.303805 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-957ac223-eb2a-4465-83e7-5eea24c8bb4a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:22.304967 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-957ac223-eb2a-4465-83e7-5eea24c8bb4a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.163485 Jul 26 12:57:22.305527 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 370/727] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:22 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:23.327003 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b446154f-282a-4905-9cad-104089bf89b2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:23.327617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b446154f-282a-4905-9cad-104089bf89b2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:23.334653 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b446154f-282a-4905-9cad-104089bf89b2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:23.335113 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b446154f-282a-4905-9cad-104089bf89b2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:23.335907 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b446154f-282a-4905-9cad-104089bf89b2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:23.336360 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b446154f-282a-4905-9cad-104089bf89b2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:23.464734 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b446154f-282a-4905-9cad-104089bf89b2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:23.472647 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b446154f-282a-4905-9cad-104089bf89b2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:23.474166 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b446154f-282a-4905-9cad-104089bf89b2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:23.475880 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b446154f-282a-4905-9cad-104089bf89b2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1747 microversion: 2.20 time: 0.152725 Jul 26 12:57:23.476595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 358/728] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:23 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:24.499615 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9b121fc5-9ede-417d-947d-f4abe702013a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:24.500246 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-9b121fc5-9ede-417d-947d-f4abe702013a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:24.508117 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9b121fc5-9ede-417d-947d-f4abe702013a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:24.508585 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9b121fc5-9ede-417d-947d-f4abe702013a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:24.509422 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9b121fc5-9ede-417d-947d-f4abe702013a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:24.509857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9b121fc5-9ede-417d-947d-f4abe702013a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:24.637064 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-9b121fc5-9ede-417d-947d-f4abe702013a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:24.644955 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-9b121fc5-9ede-417d-947d-f4abe702013a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:24.647013 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-9b121fc5-9ede-417d-947d-f4abe702013a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:24.648230 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9b121fc5-9ede-417d-947d-f4abe702013a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1747 microversion: 2.20 time: 0.152523 Jul 26 12:57:24.648792 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 371/729] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:24 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:25.672447 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8bbb67be-308c-4fab-b3cb-0549c490237e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:25.673049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8bbb67be-308c-4fab-b3cb-0549c490237e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:25.680670 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8bbb67be-308c-4fab-b3cb-0549c490237e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:25.681119 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8bbb67be-308c-4fab-b3cb-0549c490237e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:25.681891 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8bbb67be-308c-4fab-b3cb-0549c490237e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:25.682328 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8bbb67be-308c-4fab-b3cb-0549c490237e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:25.810580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8bbb67be-308c-4fab-b3cb-0549c490237e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:25.819039 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8bbb67be-308c-4fab-b3cb-0549c490237e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:25.820622 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8bbb67be-308c-4fab-b3cb-0549c490237e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:25.821855 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8bbb67be-308c-4fab-b3cb-0549c490237e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1747 microversion: 2.20 time: 0.153434 Jul 26 12:57:25.822423 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 359/730] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:25 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:26.844431 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7d2fe09a-eac2-4bba-8636-fdb04c9d03ef tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:26.846278 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7d2fe09a-eac2-4bba-8636-fdb04c9d03ef tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:26.853596 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d2fe09a-eac2-4bba-8636-fdb04c9d03ef tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:26.854287 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d2fe09a-eac2-4bba-8636-fdb04c9d03ef tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:26.855070 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d2fe09a-eac2-4bba-8636-fdb04c9d03ef tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:26.855504 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7d2fe09a-eac2-4bba-8636-fdb04c9d03ef tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:27.007049 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7d2fe09a-eac2-4bba-8636-fdb04c9d03ef tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:27.017693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7d2fe09a-eac2-4bba-8636-fdb04c9d03ef tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:27.019358 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7d2fe09a-eac2-4bba-8636-fdb04c9d03ef tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:27.020676 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7d2fe09a-eac2-4bba-8636-fdb04c9d03ef tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1742 microversion: 2.20 time: 0.180214 Jul 26 12:57:27.022299 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 372/731] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:26 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:27.424781 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-01671380-30aa-404a-a8ed-f89220d4119a req-2d456ef3-1e52-450c-b5ab-355980f4823a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146eb1e1-e26e-4f91-ad22-2cf7926f8b93", "name": "network-vif-plugged", "status": "completed", "tag": "542d7fcb-23e0-4cab-98aa-203a4db90c44"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:27.441914 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-01671380-30aa-404a-a8ed-f89220d4119a req-2d456ef3-1e52-450c-b5ab-355980f4823a service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:27.442646 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-01671380-30aa-404a-a8ed-f89220d4119a req-2d456ef3-1e52-450c-b5ab-355980f4823a service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:27.455594 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-01671380-30aa-404a-a8ed-f89220d4119a req-2d456ef3-1e52-450c-b5ab-355980f4823a service nova] Creating event network-vif-plugged:542d7fcb-23e0-4cab-98aa-203a4db90c44 for instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 on hv-cinder-85093 Jul 26 12:57:27.461912 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-01671380-30aa-404a-a8ed-f89220d4119a req-2d456ef3-1e52-450c-b5ab-355980f4823a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041517 Jul 26 12:57:27.462810 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 360/732] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:28.046250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-81a490ab-dd37-4a66-a77a-ceeb89715ff1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:28.046847 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-81a490ab-dd37-4a66-a77a-ceeb89715ff1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:28.055858 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-81a490ab-dd37-4a66-a77a-ceeb89715ff1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:28.056582 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-81a490ab-dd37-4a66-a77a-ceeb89715ff1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:28.057373 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-81a490ab-dd37-4a66-a77a-ceeb89715ff1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:28.057809 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-81a490ab-dd37-4a66-a77a-ceeb89715ff1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:28.201269 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-81a490ab-dd37-4a66-a77a-ceeb89715ff1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:28.209756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-81a490ab-dd37-4a66-a77a-ceeb89715ff1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:28.211671 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-81a490ab-dd37-4a66-a77a-ceeb89715ff1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:28.213144 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-81a490ab-dd37-4a66-a77a-ceeb89715ff1 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1742 microversion: 2.20 time: 0.170810 Jul 26 12:57:28.214204 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 373/733] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:28 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:29.242888 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-dc18eac3-8fd1-4008-acc9-c384ae922fa2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:29.243578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-dc18eac3-8fd1-4008-acc9-c384ae922fa2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:29.250769 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc18eac3-8fd1-4008-acc9-c384ae922fa2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:29.251214 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc18eac3-8fd1-4008-acc9-c384ae922fa2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:29.252004 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc18eac3-8fd1-4008-acc9-c384ae922fa2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:29.252438 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc18eac3-8fd1-4008-acc9-c384ae922fa2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:29.421559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-dc18eac3-8fd1-4008-acc9-c384ae922fa2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:29.430244 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-dc18eac3-8fd1-4008-acc9-c384ae922fa2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:29.431791 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-dc18eac3-8fd1-4008-acc9-c384ae922fa2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:29.433181 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-dc18eac3-8fd1-4008-acc9-c384ae922fa2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1742 microversion: 2.20 time: 0.194550 Jul 26 12:57:29.444161 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 361/734] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:29 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1742 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:30.456652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-87b15def-01e9-4786-bd57-8e65e167b3a2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:30.457441 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-87b15def-01e9-4786-bd57-8e65e167b3a2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:30.465564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-87b15def-01e9-4786-bd57-8e65e167b3a2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:30.466017 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-87b15def-01e9-4786-bd57-8e65e167b3a2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:30.466805 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-87b15def-01e9-4786-bd57-8e65e167b3a2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:30.467259 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-87b15def-01e9-4786-bd57-8e65e167b3a2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:30.623864 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-87b15def-01e9-4786-bd57-8e65e167b3a2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:30.633532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-87b15def-01e9-4786-bd57-8e65e167b3a2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:30.636065 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-87b15def-01e9-4786-bd57-8e65e167b3a2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:30.639727 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-87b15def-01e9-4786-bd57-8e65e167b3a2 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1742 microversion: 2.20 time: 0.186197 Jul 26 12:57:30.651663 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 374/735] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:30 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:31.663967 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-83891707-88da-45b1-8d4c-9e5d16db5052 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:31.664578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-83891707-88da-45b1-8d4c-9e5d16db5052 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:31.671969 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83891707-88da-45b1-8d4c-9e5d16db5052 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:31.672430 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83891707-88da-45b1-8d4c-9e5d16db5052 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:31.673232 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83891707-88da-45b1-8d4c-9e5d16db5052 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:31.673678 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83891707-88da-45b1-8d4c-9e5d16db5052 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:31.852796 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-83891707-88da-45b1-8d4c-9e5d16db5052 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:31.862480 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-83891707-88da-45b1-8d4c-9e5d16db5052 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:31.864180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-83891707-88da-45b1-8d4c-9e5d16db5052 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:31.865328 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-83891707-88da-45b1-8d4c-9e5d16db5052 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1742 microversion: 2.20 time: 0.205971 Jul 26 12:57:31.866494 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 362/736] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:31 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1742 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:32.890482 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f45a7f50-06f5-4098-933b-5b31e5589626 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:32.891204 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f45a7f50-06f5-4098-933b-5b31e5589626 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:32.898861 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f45a7f50-06f5-4098-933b-5b31e5589626 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:32.899322 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f45a7f50-06f5-4098-933b-5b31e5589626 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:32.900250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f45a7f50-06f5-4098-933b-5b31e5589626 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:32.900697 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f45a7f50-06f5-4098-933b-5b31e5589626 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:33.052166 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f45a7f50-06f5-4098-933b-5b31e5589626 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:33.064259 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f45a7f50-06f5-4098-933b-5b31e5589626 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:33.066863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f45a7f50-06f5-4098-933b-5b31e5589626 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:33.068068 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f45a7f50-06f5-4098-933b-5b31e5589626 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1742 microversion: 2.20 time: 0.182352 Jul 26 12:57:33.068945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 375/737] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:32 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1742 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:34.091733 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2ae8615c-7f43-4b44-9df5-1babe596e469 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:34.092439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2ae8615c-7f43-4b44-9df5-1babe596e469 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:34.100343 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2ae8615c-7f43-4b44-9df5-1babe596e469 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:34.101118 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2ae8615c-7f43-4b44-9df5-1babe596e469 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:34.102165 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2ae8615c-7f43-4b44-9df5-1babe596e469 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:34.102678 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2ae8615c-7f43-4b44-9df5-1babe596e469 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:34.260035 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2ae8615c-7f43-4b44-9df5-1babe596e469 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:34.272393 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2ae8615c-7f43-4b44-9df5-1babe596e469 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:34.274076 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2ae8615c-7f43-4b44-9df5-1babe596e469 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:34.275459 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2ae8615c-7f43-4b44-9df5-1babe596e469 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1742 microversion: 2.20 time: 0.187612 Jul 26 12:57:34.276970 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 363/738] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:34 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1742 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:35.300327 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-12701159-2fbb-48a3-8d11-ad0432da6042 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:35.300882 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-12701159-2fbb-48a3-8d11-ad0432da6042 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:35.307440 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-12701159-2fbb-48a3-8d11-ad0432da6042 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:35.307922 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-12701159-2fbb-48a3-8d11-ad0432da6042 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:35.308696 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-12701159-2fbb-48a3-8d11-ad0432da6042 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:35.309121 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-12701159-2fbb-48a3-8d11-ad0432da6042 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:35.436633 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-12701159-2fbb-48a3-8d11-ad0432da6042 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:35.448690 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-12701159-2fbb-48a3-8d11-ad0432da6042 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:35.452061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-12701159-2fbb-48a3-8d11-ad0432da6042 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:35.453245 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-12701159-2fbb-48a3-8d11-ad0432da6042 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1742 microversion: 2.20 time: 0.156858 Jul 26 12:57:35.453808 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 376/739] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:35 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:36.476078 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-be34054d-598e-41e6-aa33-4a9262709715 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:36.476799 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-be34054d-598e-41e6-aa33-4a9262709715 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:36.483491 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-be34054d-598e-41e6-aa33-4a9262709715 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:36.483981 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-be34054d-598e-41e6-aa33-4a9262709715 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:36.484762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-be34054d-598e-41e6-aa33-4a9262709715 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:36.485203 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-be34054d-598e-41e6-aa33-4a9262709715 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:36.624715 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-be34054d-598e-41e6-aa33-4a9262709715 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:36.633590 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-be34054d-598e-41e6-aa33-4a9262709715 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:36.635083 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-be34054d-598e-41e6-aa33-4a9262709715 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:36.636392 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-be34054d-598e-41e6-aa33-4a9262709715 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1724 microversion: 2.20 time: 0.164862 Jul 26 12:57:36.636949 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 364/740] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:36 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:37.251282 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-786679f5-1780-4273-ade3-ecdd85359510 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:37.251841 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-786679f5-1780-4273-ade3-ecdd85359510 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:37.258589 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-786679f5-1780-4273-ade3-ecdd85359510 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:37.259131 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-786679f5-1780-4273-ade3-ecdd85359510 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:37.259959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-786679f5-1780-4273-ade3-ecdd85359510 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:37.260396 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-786679f5-1780-4273-ade3-ecdd85359510 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:37.285656 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-786679f5-1780-4273-ade3-ecdd85359510 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Going to try to terminate instance {{(pid=129308) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:57:37.361202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-786679f5-1780-4273-ade3-ecdd85359510 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 204 len: 0 microversion: 2.1 time: 0.113526 Jul 26 12:57:37.361770 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 377/741] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:57:37 2022] DELETE /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:57:37.369916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-99076f0d-d27b-442e-a86e-e301ce5758da tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:37.370528 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-99076f0d-d27b-442e-a86e-e301ce5758da tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:37.376586 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-99076f0d-d27b-442e-a86e-e301ce5758da tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:37.377032 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-99076f0d-d27b-442e-a86e-e301ce5758da tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:37.377790 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-99076f0d-d27b-442e-a86e-e301ce5758da tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:37.378229 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-99076f0d-d27b-442e-a86e-e301ce5758da tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:37.511180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-99076f0d-d27b-442e-a86e-e301ce5758da tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:37.518605 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-99076f0d-d27b-442e-a86e-e301ce5758da tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1579 microversion: 2.1 time: 0.152600 Jul 26 12:57:37.519166 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 365/742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:37 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:37.660284 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ff1fb458-a461-4b15-b5d1-2c1a75f1dfc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:37.660980 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ff1fb458-a461-4b15-b5d1-2c1a75f1dfc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:37.667053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff1fb458-a461-4b15-b5d1-2c1a75f1dfc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:37.667505 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff1fb458-a461-4b15-b5d1-2c1a75f1dfc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:37.668311 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff1fb458-a461-4b15-b5d1-2c1a75f1dfc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:37.668750 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff1fb458-a461-4b15-b5d1-2c1a75f1dfc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:37.805274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ff1fb458-a461-4b15-b5d1-2c1a75f1dfc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:37.813764 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ff1fb458-a461-4b15-b5d1-2c1a75f1dfc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:37.815276 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ff1fb458-a461-4b15-b5d1-2c1a75f1dfc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:37.816461 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ff1fb458-a461-4b15-b5d1-2c1a75f1dfc0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1724 microversion: 2.20 time: 0.160574 Jul 26 12:57:37.817020 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 378/743] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:37 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:38.540076 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-35595fba-f1ee-4345-8d50-cf1db318a430 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:38.540695 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-35595fba-f1ee-4345-8d50-cf1db318a430 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:38.547159 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35595fba-f1ee-4345-8d50-cf1db318a430 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:38.547611 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35595fba-f1ee-4345-8d50-cf1db318a430 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:38.548411 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35595fba-f1ee-4345-8d50-cf1db318a430 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:38.548886 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35595fba-f1ee-4345-8d50-cf1db318a430 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:38.681991 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-35595fba-f1ee-4345-8d50-cf1db318a430 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:38.690434 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-35595fba-f1ee-4345-8d50-cf1db318a430 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1579 microversion: 2.1 time: 0.154199 Jul 26 12:57:38.690997 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 366/744] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:38 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:38.839799 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f0851deb-0206-4db1-99a2-e0724a54d0e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:38.840321 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f0851deb-0206-4db1-99a2-e0724a54d0e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:38.846812 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f0851deb-0206-4db1-99a2-e0724a54d0e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:38.847252 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f0851deb-0206-4db1-99a2-e0724a54d0e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:38.848394 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f0851deb-0206-4db1-99a2-e0724a54d0e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:38.848514 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f0851deb-0206-4db1-99a2-e0724a54d0e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:38.979099 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f0851deb-0206-4db1-99a2-e0724a54d0e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:38.987608 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f0851deb-0206-4db1-99a2-e0724a54d0e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:38.989135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f0851deb-0206-4db1-99a2-e0724a54d0e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:38.990940 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f0851deb-0206-4db1-99a2-e0724a54d0e3 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1724 microversion: 2.20 time: 0.154429 Jul 26 12:57:38.991497 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 379/745] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:38 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:39.441502 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-eb5021ae-7381-4150-a198-969d9880b622 req-16d3b517-1099-4333-829b-859f5e3638f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146eb1e1-e26e-4f91-ad22-2cf7926f8b93", "name": "network-vif-unplugged", "status": "completed", "tag": "542d7fcb-23e0-4cab-98aa-203a4db90c44"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:39.452388 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-eb5021ae-7381-4150-a198-969d9880b622 req-16d3b517-1099-4333-829b-859f5e3638f0 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:39.452838 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-eb5021ae-7381-4150-a198-969d9880b622 req-16d3b517-1099-4333-829b-859f5e3638f0 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:39.466139 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-eb5021ae-7381-4150-a198-969d9880b622 req-16d3b517-1099-4333-829b-859f5e3638f0 service nova] Creating event network-vif-unplugged:542d7fcb-23e0-4cab-98aa-203a4db90c44 for instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 on hv-cinder-85093 Jul 26 12:57:39.471150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-eb5021ae-7381-4150-a198-969d9880b622 req-16d3b517-1099-4333-829b-859f5e3638f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033292 Jul 26 12:57:39.471942 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 367/746] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:39.712059 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e9df6586-bb5b-4e22-ab9f-a16fd9b82f2d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:39.712671 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e9df6586-bb5b-4e22-ab9f-a16fd9b82f2d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:39.718675 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e9df6586-bb5b-4e22-ab9f-a16fd9b82f2d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:39.719132 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e9df6586-bb5b-4e22-ab9f-a16fd9b82f2d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:39.719935 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e9df6586-bb5b-4e22-ab9f-a16fd9b82f2d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:39.720406 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e9df6586-bb5b-4e22-ab9f-a16fd9b82f2d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:39.935934 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e9df6586-bb5b-4e22-ab9f-a16fd9b82f2d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:39.943419 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e9df6586-bb5b-4e22-ab9f-a16fd9b82f2d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1579 microversion: 2.1 time: 0.235393 Jul 26 12:57:39.944015 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 380/747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:39 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1579 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:40.015977 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2d0c87c0-3dac-46a0-8a6a-b7478caf3288 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:40.016856 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2d0c87c0-3dac-46a0-8a6a-b7478caf3288 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:40.024082 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2d0c87c0-3dac-46a0-8a6a-b7478caf3288 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:40.024539 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2d0c87c0-3dac-46a0-8a6a-b7478caf3288 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:40.025317 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2d0c87c0-3dac-46a0-8a6a-b7478caf3288 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:40.025760 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2d0c87c0-3dac-46a0-8a6a-b7478caf3288 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:40.156594 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2d0c87c0-3dac-46a0-8a6a-b7478caf3288 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:40.165537 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2d0c87c0-3dac-46a0-8a6a-b7478caf3288 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:40.167081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2d0c87c0-3dac-46a0-8a6a-b7478caf3288 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:40.168273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2d0c87c0-3dac-46a0-8a6a-b7478caf3288 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1667 microversion: 2.20 time: 0.157613 Jul 26 12:57:40.168815 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 368/748] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:40 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:40.190982 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-2f176ace-bcf9-4834-9fb1-031d80e4fa1f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ed9fd95-405c-45c4-b519-87efa5e4eea5"}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:40.193438 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-2f176ace-bcf9-4834-9fb1-031d80e4fa1f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:40.199529 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2f176ace-bcf9-4834-9fb1-031d80e4fa1f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:40.200031 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2f176ace-bcf9-4834-9fb1-031d80e4fa1f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:40.200794 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2f176ace-bcf9-4834-9fb1-031d80e4fa1f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:40.201227 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2f176ace-bcf9-4834-9fb1-031d80e4fa1f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:40.491803 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-2f176ace-bcf9-4834-9fb1-031d80e4fa1f tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "POST /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304429 Jul 26 12:57:40.492225 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 381/749] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Jul 26 12:57:40 2022] POST /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 12:57:40.544794 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-cd40ff3a-f57e-4a22-b878-99f7c1dbc2a7 req-00c588b1-7e1e-4a1d-9e52-06e73effc602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d9b3cf-bdc1-4718-83b8-f0136bfa33c6", "name": "network-vif-deleted", "tag": "030b2999-9a99-45a6-b101-7ab33c5916a7"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:40.561120 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-cd40ff3a-f57e-4a22-b878-99f7c1dbc2a7 req-00c588b1-7e1e-4a1d-9e52-06e73effc602 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:40.561688 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-cd40ff3a-f57e-4a22-b878-99f7c1dbc2a7 req-00c588b1-7e1e-4a1d-9e52-06e73effc602 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:40.575580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-cd40ff3a-f57e-4a22-b878-99f7c1dbc2a7 req-00c588b1-7e1e-4a1d-9e52-06e73effc602 service nova] Creating event network-vif-deleted:030b2999-9a99-45a6-b101-7ab33c5916a7 for instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 on hv-cinder-85093 Jul 26 12:57:40.581646 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-cd40ff3a-f57e-4a22-b878-99f7c1dbc2a7 req-00c588b1-7e1e-4a1d-9e52-06e73effc602 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042314 Jul 26 12:57:40.583083 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 369/750] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:40.641831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-78416cd6-5005-4d0c-8d6e-7b653e51fe00 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:40.642335 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-78416cd6-5005-4d0c-8d6e-7b653e51fe00 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:40.649476 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-78416cd6-5005-4d0c-8d6e-7b653e51fe00 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:40.649926 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-78416cd6-5005-4d0c-8d6e-7b653e51fe00 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:40.650716 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-78416cd6-5005-4d0c-8d6e-7b653e51fe00 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:40.651157 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-78416cd6-5005-4d0c-8d6e-7b653e51fe00 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:40.747066 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:40.943719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-78416cd6-5005-4d0c-8d6e-7b653e51fe00 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "DELETE /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/os-volume_attachments/1ed9fd95-405c-45c4-b519-87efa5e4eea5" status: 202 len: 0 microversion: 2.20 time: 0.305589 Jul 26 12:57:40.944384 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 382/751] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Jul 26 12:57:40 2022] DELETE /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/os-volume_attachments/1ed9fd95-405c-45c4-b519-87efa5e4eea5 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:57:40.969485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-7d26f441-e551-4861-8b2f-3b81f41ff5a8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:40.970561 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-7d26f441-e551-4861-8b2f-3b81f41ff5a8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:40.979123 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7d26f441-e551-4861-8b2f-3b81f41ff5a8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:40.979953 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7d26f441-e551-4861-8b2f-3b81f41ff5a8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:40.980808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7d26f441-e551-4861-8b2f-3b81f41ff5a8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:40.981398 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7d26f441-e551-4861-8b2f-3b81f41ff5a8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:41.009710 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7a7f92dd-937f-4c71-a8d1-2c053dbe981e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:41.010724 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7a7f92dd-937f-4c71-a8d1-2c053dbe981e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:41.016787 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7d26f441-e551-4861-8b2f-3b81f41ff5a8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:41.017268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7a7f92dd-937f-4c71-a8d1-2c053dbe981e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:41.017676 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7a7f92dd-937f-4c71-a8d1-2c053dbe981e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:41.017897 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7d26f441-e551-4861-8b2f-3b81f41ff5a8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:41.018320 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-7d26f441-e551-4861-8b2f-3b81f41ff5a8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lazy-loading 'fault' on Instance uuid 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:57:41.018449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7a7f92dd-937f-4c71-a8d1-2c053dbe981e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:41.018878 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7a7f92dd-937f-4c71-a8d1-2c053dbe981e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:41.066688 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-7d26f441-e551-4861-8b2f-3b81f41ff5a8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:41.077026 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-7d26f441-e551-4861-8b2f-3b81f41ff5a8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 200 len: 1231 microversion: 2.1 time: 0.116012 Jul 26 12:57:41.077719 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 370/752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:40 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 1231 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:41.118633 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7a7f92dd-937f-4c71-a8d1-2c053dbe981e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "POST /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/action" status: 202 len: 0 microversion: 2.20 time: 0.113838 Jul 26 12:57:41.119415 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 383/753] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Jul 26 12:57:41 2022] POST /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 12:57:41.128136 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3ce473f3-a6ab-49fb-8880-6973bfdded83 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:41.128907 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3ce473f3-a6ab-49fb-8880-6973bfdded83 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:41.136095 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3ce473f3-a6ab-49fb-8880-6973bfdded83 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:41.136780 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3ce473f3-a6ab-49fb-8880-6973bfdded83 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:41.137549 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3ce473f3-a6ab-49fb-8880-6973bfdded83 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:41.137985 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3ce473f3-a6ab-49fb-8880-6973bfdded83 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:41.312754 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3ce473f3-a6ab-49fb-8880-6973bfdded83 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:41.338325 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3ce473f3-a6ab-49fb-8880-6973bfdded83 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:41.340861 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3ce473f3-a6ab-49fb-8880-6973bfdded83 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:41.342339 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3ce473f3-a6ab-49fb-8880-6973bfdded83 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1675 microversion: 2.20 time: 0.218396 Jul 26 12:57:41.343701 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 371/754] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:41 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1675 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:57:42.097815 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9986cbee-81b3-4fa1-b3ab-e39a4e5f8a29 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:42.098396 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-9986cbee-81b3-4fa1-b3ab-e39a4e5f8a29 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:42.104554 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9986cbee-81b3-4fa1-b3ab-e39a4e5f8a29 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:42.104996 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9986cbee-81b3-4fa1-b3ab-e39a4e5f8a29 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:42.105773 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9986cbee-81b3-4fa1-b3ab-e39a4e5f8a29 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:42.106199 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9986cbee-81b3-4fa1-b3ab-e39a4e5f8a29 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:42.119307 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-9986cbee-81b3-4fa1-b3ab-e39a4e5f8a29 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] HTTP exception thrown: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9986cbee-81b3-4fa1-b3ab-e39a4e5f8a29 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Request method failure captured: Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 HTTP/1.1 Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-P6I4oZJTGyBxyXC8K7pa2GPTfIJf6EOGmVLtC59ScPVeMnVd7rnTVHCojwupIXZrf2bh_e2EqqpfganxExWxX_GLRgJYV2f7mYDtQh9nCrZd0yfcEhBeZKdqmQITp2eixdDBPg-Y0vW3RkVC902oxYQPTGR0qCwCaspEZOyZrnaCE Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: a2522985c6df452dabe2010e5f6bed35 Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-TestVolumeBootPattern-763444378 Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:57:42.120959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:57:42.122571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2522985c6df452dabe2010e5f6bed35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2522985c6df452dabe2010e5f6bed35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2522985c6df452dabe2010e5f6bed35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2522985c6df452dabe2010e5f6bed35"}]}] Jul 26 12:57:42.122571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-TestVolumeBootPattern-763444378 Jul 26 12:57:42.122571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: a2522985c6df452dabe2010e5f6bed35 Jul 26 12:57:42.122571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-TestVolumeBootPattern-763444378 Jul 26 12:57:42.122571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-TestVolumeBootPattern-763444378-project Jul 26 12:57:42.122571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:57:42.122571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:57:42.122571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 94efba410653451da2e9977d746633f6 Jul 26 12:57:42.122571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-TestVolumeBootPattern-763444378-project Jul 26 12:57:42.122571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:57:42.122571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 12:57:42.122571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '48d9b3cf-bdc1-4718-83b8-f0136bfa33c6'} Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:57:42.123454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 12:57:42.124945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:57:42.126289 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9986cbee-81b3-4fa1-b3ab-e39a4e5f8a29 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Returning 404 to user: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:57:42.126289 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9986cbee-81b3-4fa1-b3ab-e39a4e5f8a29 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 404 len: 111 microversion: 2.1 time: 0.028514 Jul 26 12:57:42.126289 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 384/755] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:42 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:57:42.220812 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-719205201", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1602648222", "security_groups": [{"name": "tempest-secgroup-smoke-1409511889"}], "block_device_mapping_v2": [{"uuid": "8c031615-2da1-41da-bf24-0d5279bef175", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8b53c01d-8651-463b-8de8-06dcdf11a64f"}]}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:42.230751 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=44 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:42.334239 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.network.neutron [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] validate_networks() for [('8b53c01d-8651-463b-8de8-06dcdf11a64f', None, None, None, None, None)] {{(pid=129307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:57:42.367299 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-682d5313-1266-4f43-b88a-f271329229ad tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:42.367932 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-682d5313-1266-4f43-b88a-f271329229ad tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:42.369791 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:42.375742 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-682d5313-1266-4f43-b88a-f271329229ad tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:42.376376 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-682d5313-1266-4f43-b88a-f271329229ad tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:42.377245 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-682d5313-1266-4f43-b88a-f271329229ad tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:42.377940 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-682d5313-1266-4f43-b88a-f271329229ad tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:42.572519 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-682d5313-1266-4f43-b88a-f271329229ad tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:42.581225 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-682d5313-1266-4f43-b88a-f271329229ad tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:42.582908 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-682d5313-1266-4f43-b88a-f271329229ad tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:42.584511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-682d5313-1266-4f43-b88a-f271329229ad tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.221862 Jul 26 12:57:42.585538 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 385/756] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:42 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:57:42.724388 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Flavor limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:57:42.724820 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Image limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:57:42.725335 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Flavor pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:57:42.725748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Image pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:57:42.726832 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:57:42.736878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:42.737330 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:42.738169 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:42.738606 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:42.757065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Getting quotas for project a2522985c6df452dabe2010e5f6bed35. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:57:42.761095 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Getting quotas for user 94efba410653451da2e9977d746633f6 and project a2522985c6df452dabe2010e5f6bed35. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:57:42.821505 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Going to run 1 instances... {{(pid=129307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:57:42.824831 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c031615-2da1-41da-bf24-0d5279bef175',volume_size=None,volume_type=None)] {{(pid=129307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:57:42.962609 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-791bddd2-8946-4739-bb37-0c8b7803671e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745550 Jul 26 12:57:42.963516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 372/757] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:57:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 12:57:42.975366 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3128e91b-6cf1-4dee-9848-54550e6f0431 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:42.976644 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3128e91b-6cf1-4dee-9848-54550e6f0431 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:43.318045 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-de144445-f3da-4a06-8e9b-e445b42eee49 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:43.318625 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-de144445-f3da-4a06-8e9b-e445b42eee49 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:43.329825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-de144445-f3da-4a06-8e9b-e445b42eee49 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:43.330191 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-de144445-f3da-4a06-8e9b-e445b42eee49 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:43.336443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-de144445-f3da-4a06-8e9b-e445b42eee49 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:43.337296 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-de144445-f3da-4a06-8e9b-e445b42eee49 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:43.363334 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3128e91b-6cf1-4dee-9848-54550e6f0431 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:43.370730 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3128e91b-6cf1-4dee-9848-54550e6f0431 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1094 microversion: 2.1 time: 0.399645 Jul 26 12:57:43.380943 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-de144445-f3da-4a06-8e9b-e445b42eee49 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/ips" status: 200 len: 148 microversion: 2.1 time: 0.068087 Jul 26 12:57:43.388134 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 386/758] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:42 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1094 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:43.389998 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 373/759] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Jul 26 12:57:43 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/ips => generated 148 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:43.608639 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-43a231c5-edb8-4c97-8f7e-4b46e41ab167 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:43.609250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-43a231c5-edb8-4c97-8f7e-4b46e41ab167 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:43.619128 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-43a231c5-edb8-4c97-8f7e-4b46e41ab167 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:43.619578 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-43a231c5-edb8-4c97-8f7e-4b46e41ab167 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:43.620381 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-43a231c5-edb8-4c97-8f7e-4b46e41ab167 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:43.620816 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-43a231c5-edb8-4c97-8f7e-4b46e41ab167 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:43.856587 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-43a231c5-edb8-4c97-8f7e-4b46e41ab167 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:43.874751 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-43a231c5-edb8-4c97-8f7e-4b46e41ab167 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:43.877179 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-43a231c5-edb8-4c97-8f7e-4b46e41ab167 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:43.878929 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-43a231c5-edb8-4c97-8f7e-4b46e41ab167 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.274444 Jul 26 12:57:43.879989 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 387/760] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:43 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:44.395900 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-03e5cf09-2595-4639-b4ca-e0c86d914ead tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:44.396499 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-03e5cf09-2595-4639-b4ca-e0c86d914ead tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:44.403965 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-03e5cf09-2595-4639-b4ca-e0c86d914ead tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:44.404418 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-03e5cf09-2595-4639-b4ca-e0c86d914ead tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:44.405182 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-03e5cf09-2595-4639-b4ca-e0c86d914ead tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:44.405615 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-03e5cf09-2595-4639-b4ca-e0c86d914ead tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:44.469344 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-03e5cf09-2595-4639-b4ca-e0c86d914ead tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:44.478161 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-03e5cf09-2595-4639-b4ca-e0c86d914ead tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1144 microversion: 2.1 time: 0.086105 Jul 26 12:57:44.478934 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 374/761] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:44 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:44.875794 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-61c32ebb-f0f4-4747-982d-36468aa4d039 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a9261bb-f60d-4fd5-8632-b22e1d883890"}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:44.878248 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-61c32ebb-f0f4-4747-982d-36468aa4d039 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:44.885279 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-61c32ebb-f0f4-4747-982d-36468aa4d039 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:44.885730 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-61c32ebb-f0f4-4747-982d-36468aa4d039 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:44.886507 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-61c32ebb-f0f4-4747-982d-36468aa4d039 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:44.886942 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-61c32ebb-f0f4-4747-982d-36468aa4d039 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:44.902401 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b08e9362-929d-4de6-9da2-0e9dc2184d3a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:44.903390 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b08e9362-929d-4de6-9da2-0e9dc2184d3a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:44.909855 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b08e9362-929d-4de6-9da2-0e9dc2184d3a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:44.910388 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b08e9362-929d-4de6-9da2-0e9dc2184d3a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:44.911355 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b08e9362-929d-4de6-9da2-0e9dc2184d3a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:44.911959 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b08e9362-929d-4de6-9da2-0e9dc2184d3a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:44.935819 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=100 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:45.065900 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b08e9362-929d-4de6-9da2-0e9dc2184d3a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:45.074122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b08e9362-929d-4de6-9da2-0e9dc2184d3a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:45.075549 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b08e9362-929d-4de6-9da2-0e9dc2184d3a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:45.076854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b08e9362-929d-4de6-9da2-0e9dc2184d3a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.178309 Jul 26 12:57:45.077408 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 375/762] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:44 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:57:45.499036 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-44c45cc6-da0e-4bc8-8e52-43b857563e42 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:45.499930 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-44c45cc6-da0e-4bc8-8e52-43b857563e42 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:45.506363 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-44c45cc6-da0e-4bc8-8e52-43b857563e42 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:45.506892 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-44c45cc6-da0e-4bc8-8e52-43b857563e42 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:45.508319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-44c45cc6-da0e-4bc8-8e52-43b857563e42 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:45.510948 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-44c45cc6-da0e-4bc8-8e52-43b857563e42 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:45.574673 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-44c45cc6-da0e-4bc8-8e52-43b857563e42 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:45.582762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-44c45cc6-da0e-4bc8-8e52-43b857563e42 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1144 microversion: 2.1 time: 0.087610 Jul 26 12:57:45.583344 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 376/763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:45 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:46.101650 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6e398729-8bf8-4a1c-b4c3-9f28a924343e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:46.102175 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-6e398729-8bf8-4a1c-b4c3-9f28a924343e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:46.108177 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6e398729-8bf8-4a1c-b4c3-9f28a924343e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:46.108630 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6e398729-8bf8-4a1c-b4c3-9f28a924343e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:46.109390 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6e398729-8bf8-4a1c-b4c3-9f28a924343e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:46.109825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6e398729-8bf8-4a1c-b4c3-9f28a924343e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:46.242096 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-6e398729-8bf8-4a1c-b4c3-9f28a924343e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:46.249907 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-6e398729-8bf8-4a1c-b4c3-9f28a924343e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:46.251439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-6e398729-8bf8-4a1c-b4c3-9f28a924343e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:46.252639 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-6e398729-8bf8-4a1c-b4c3-9f28a924343e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.155700 Jul 26 12:57:46.255594 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 377/764] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:46 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:57:46.272071 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f57460f5-90b0-4296-96f9-a7346b2f3e5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:46.272665 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f57460f5-90b0-4296-96f9-a7346b2f3e5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:46.281894 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f57460f5-90b0-4296-96f9-a7346b2f3e5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:46.282434 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f57460f5-90b0-4296-96f9-a7346b2f3e5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:46.283318 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f57460f5-90b0-4296-96f9-a7346b2f3e5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:46.283686 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f57460f5-90b0-4296-96f9-a7346b2f3e5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:46.308491 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-f57460f5-90b0-4296-96f9-a7346b2f3e5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lazy-loading 'flavor' on Instance uuid f1331709-485e-470a-9dcb-0b8832524597 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:57:46.391369 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f57460f5-90b0-4296-96f9-a7346b2f3e5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "POST /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597/action" status: 202 len: 0 microversion: 2.1 time: 0.126185 Jul 26 12:57:46.392639 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 378/765] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 12:57:46 2022] POST /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:57:46.401686 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-878a458f-f4d0-4d87-8c2d-b2492f240e77 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:46.402882 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-878a458f-f4d0-4d87-8c2d-b2492f240e77 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:46.410859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-878a458f-f4d0-4d87-8c2d-b2492f240e77 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:46.411321 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-878a458f-f4d0-4d87-8c2d-b2492f240e77 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:46.412127 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-878a458f-f4d0-4d87-8c2d-b2492f240e77 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:46.412567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-878a458f-f4d0-4d87-8c2d-b2492f240e77 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:46.570450 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-878a458f-f4d0-4d87-8c2d-b2492f240e77 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:46.580474 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-878a458f-f4d0-4d87-8c2d-b2492f240e77 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.183544 Jul 26 12:57:46.581196 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 379/766] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:46 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:46.603401 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6187b3a4-fb6f-450d-acd0-619dce5ca4f5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:46.604053 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-6187b3a4-fb6f-450d-acd0-619dce5ca4f5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:46.610891 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6187b3a4-fb6f-450d-acd0-619dce5ca4f5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:46.611348 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6187b3a4-fb6f-450d-acd0-619dce5ca4f5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:46.612411 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6187b3a4-fb6f-450d-acd0-619dce5ca4f5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:46.612865 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6187b3a4-fb6f-450d-acd0-619dce5ca4f5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:46.676575 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-6187b3a4-fb6f-450d-acd0-619dce5ca4f5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:46.685096 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-6187b3a4-fb6f-450d-acd0-619dce5ca4f5 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1144 microversion: 2.1 time: 0.085448 Jul 26 12:57:46.685714 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 380/767] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:46 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:47.279711 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-83235c30-0a23-4520-b414-c129d58861ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:47.280318 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-83235c30-0a23-4520-b414-c129d58861ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:47.286667 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83235c30-0a23-4520-b414-c129d58861ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:47.287120 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83235c30-0a23-4520-b414-c129d58861ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:47.287918 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83235c30-0a23-4520-b414-c129d58861ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:47.288380 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-83235c30-0a23-4520-b414-c129d58861ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:47.425962 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-83235c30-0a23-4520-b414-c129d58861ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:47.434947 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-83235c30-0a23-4520-b414-c129d58861ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:47.436420 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-83235c30-0a23-4520-b414-c129d58861ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:47.437584 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-83235c30-0a23-4520-b414-c129d58861ba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.161794 Jul 26 12:57:47.438146 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 381/768] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:47 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:47.602678 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3921d7b1-1578-4bce-baf0-ed4195ae97a7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:47.603692 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3921d7b1-1578-4bce-baf0-ed4195ae97a7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:47.610651 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3921d7b1-1578-4bce-baf0-ed4195ae97a7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:47.611114 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3921d7b1-1578-4bce-baf0-ed4195ae97a7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:47.611940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3921d7b1-1578-4bce-baf0-ed4195ae97a7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:47.612382 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3921d7b1-1578-4bce-baf0-ed4195ae97a7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:47.754240 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3921d7b1-1578-4bce-baf0-ed4195ae97a7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:47.763326 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3921d7b1-1578-4bce-baf0-ed4195ae97a7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.164687 Jul 26 12:57:47.767580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 382/769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:47 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:47.771075 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-bfd20fa7-5cb8-48ed-8e80-46dfbbe9c984 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:47.771792 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-bfd20fa7-5cb8-48ed-8e80-46dfbbe9c984 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:47.778508 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bfd20fa7-5cb8-48ed-8e80-46dfbbe9c984 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:47.778966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bfd20fa7-5cb8-48ed-8e80-46dfbbe9c984 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:47.779800 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bfd20fa7-5cb8-48ed-8e80-46dfbbe9c984 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:47.780300 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bfd20fa7-5cb8-48ed-8e80-46dfbbe9c984 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:47.844621 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bfd20fa7-5cb8-48ed-8e80-46dfbbe9c984 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:47.852723 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-bfd20fa7-5cb8-48ed-8e80-46dfbbe9c984 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1144 microversion: 2.1 time: 0.087717 Jul 26 12:57:47.853314 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 383/770] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:47 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:48.462505 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-bb377ad0-f2a0-403d-9a02-0ea639bb634a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:48.463122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-bb377ad0-f2a0-403d-9a02-0ea639bb634a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:48.469505 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bb377ad0-f2a0-403d-9a02-0ea639bb634a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:48.469965 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bb377ad0-f2a0-403d-9a02-0ea639bb634a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:48.470744 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bb377ad0-f2a0-403d-9a02-0ea639bb634a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:48.471182 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bb377ad0-f2a0-403d-9a02-0ea639bb634a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:48.870052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bb377ad0-f2a0-403d-9a02-0ea639bb634a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:48.880764 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bb377ad0-f2a0-403d-9a02-0ea639bb634a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:48.886590 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bb377ad0-f2a0-403d-9a02-0ea639bb634a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:48.888501 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-bb377ad0-f2a0-403d-9a02-0ea639bb634a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.429808 Jul 26 12:57:48.889287 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 384/771] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:48 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:57:48.894421 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5bfbcba3-dfcd-4473-96e2-d341df498b1b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:48.895040 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5bfbcba3-dfcd-4473-96e2-d341df498b1b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:48.901801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5bfbcba3-dfcd-4473-96e2-d341df498b1b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:48.902288 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5bfbcba3-dfcd-4473-96e2-d341df498b1b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:48.903083 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5bfbcba3-dfcd-4473-96e2-d341df498b1b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:48.903566 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5bfbcba3-dfcd-4473-96e2-d341df498b1b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:49.063017 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5bfbcba3-dfcd-4473-96e2-d341df498b1b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:49.074196 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5bfbcba3-dfcd-4473-96e2-d341df498b1b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.183385 Jul 26 12:57:49.074981 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 385/772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:48 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:49.079572 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-833cafea-8ab0-4993-9062-f789331f2317 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:49.080211 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-833cafea-8ab0-4993-9062-f789331f2317 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:49.088386 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-833cafea-8ab0-4993-9062-f789331f2317 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:49.088849 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-833cafea-8ab0-4993-9062-f789331f2317 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:49.089633 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-833cafea-8ab0-4993-9062-f789331f2317 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:49.090072 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-833cafea-8ab0-4993-9062-f789331f2317 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:49.157582 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-833cafea-8ab0-4993-9062-f789331f2317 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:49.172327 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-833cafea-8ab0-4993-9062-f789331f2317 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1144 microversion: 2.1 time: 0.095950 Jul 26 12:57:49.173535 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 386/773] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:49 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:49.913058 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3fc66a60-2ab1-4fca-9475-aa663740b280 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:49.914084 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3fc66a60-2ab1-4fca-9475-aa663740b280 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:49.923359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3fc66a60-2ab1-4fca-9475-aa663740b280 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:49.923872 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3fc66a60-2ab1-4fca-9475-aa663740b280 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:49.924674 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3fc66a60-2ab1-4fca-9475-aa663740b280 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:49.925118 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3fc66a60-2ab1-4fca-9475-aa663740b280 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:50.078471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3fc66a60-2ab1-4fca-9475-aa663740b280 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:50.087220 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3fc66a60-2ab1-4fca-9475-aa663740b280 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:50.088772 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3fc66a60-2ab1-4fca-9475-aa663740b280 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:50.090614 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3fc66a60-2ab1-4fca-9475-aa663740b280 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.181205 Jul 26 12:57:50.091071 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 387/774] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:49 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:57:50.096080 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4b3516b6-900c-47d7-bd50-348404f34431 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:50.096657 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4b3516b6-900c-47d7-bd50-348404f34431 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:50.105111 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4b3516b6-900c-47d7-bd50-348404f34431 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:50.105639 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4b3516b6-900c-47d7-bd50-348404f34431 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:50.106552 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4b3516b6-900c-47d7-bd50-348404f34431 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:50.107029 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4b3516b6-900c-47d7-bd50-348404f34431 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:50.273324 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4b3516b6-900c-47d7-bd50-348404f34431 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:50.282274 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4b3516b6-900c-47d7-bd50-348404f34431 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.190036 Jul 26 12:57:50.282861 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 388/775] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:50 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:50.293004 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e1f96196-bfd8-4e9c-9b2d-0785e7cc8cf3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:50.293615 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e1f96196-bfd8-4e9c-9b2d-0785e7cc8cf3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:50.300639 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e1f96196-bfd8-4e9c-9b2d-0785e7cc8cf3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:50.301106 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e1f96196-bfd8-4e9c-9b2d-0785e7cc8cf3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:50.301906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e1f96196-bfd8-4e9c-9b2d-0785e7cc8cf3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:50.302306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e1f96196-bfd8-4e9c-9b2d-0785e7cc8cf3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:50.367406 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e1f96196-bfd8-4e9c-9b2d-0785e7cc8cf3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:50.376020 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e1f96196-bfd8-4e9c-9b2d-0785e7cc8cf3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1144 microversion: 2.1 time: 0.092092 Jul 26 12:57:50.376616 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 389/776] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:50 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:51.113347 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-99473f91-29cf-49c3-bdff-f75d2d9bbbcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:51.114164 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-99473f91-29cf-49c3-bdff-f75d2d9bbbcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:51.120727 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-99473f91-29cf-49c3-bdff-f75d2d9bbbcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:51.121176 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-99473f91-29cf-49c3-bdff-f75d2d9bbbcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:51.121950 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-99473f91-29cf-49c3-bdff-f75d2d9bbbcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:51.122392 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-99473f91-29cf-49c3-bdff-f75d2d9bbbcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:51.126760 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:51.275769 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-99473f91-29cf-49c3-bdff-f75d2d9bbbcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:51.283676 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-99473f91-29cf-49c3-bdff-f75d2d9bbbcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:51.285192 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-99473f91-29cf-49c3-bdff-f75d2d9bbbcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:51.286354 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-99473f91-29cf-49c3-bdff-f75d2d9bbbcc tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.176985 Jul 26 12:57:51.286924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 390/777] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:51 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:57:51.311354 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-0353373d-b611-4e3c-a7e2-dc13e7e4f79e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:51.312383 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-0353373d-b611-4e3c-a7e2-dc13e7e4f79e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:51.323240 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0353373d-b611-4e3c-a7e2-dc13e7e4f79e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:51.323878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0353373d-b611-4e3c-a7e2-dc13e7e4f79e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:51.324671 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0353373d-b611-4e3c-a7e2-dc13e7e4f79e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:51.325158 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0353373d-b611-4e3c-a7e2-dc13e7e4f79e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:51.468121 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-0353373d-b611-4e3c-a7e2-dc13e7e4f79e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:51.476277 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-0353373d-b611-4e3c-a7e2-dc13e7e4f79e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.170863 Jul 26 12:57:51.477067 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 391/778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:51 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:51.481626 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-20db190e-d1ca-4d96-a852-2c4f78dc56d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:51.482418 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-20db190e-d1ca-4d96-a852-2c4f78dc56d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:51.513724 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20db190e-d1ca-4d96-a852-2c4f78dc56d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:51.514170 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20db190e-d1ca-4d96-a852-2c4f78dc56d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:51.514940 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20db190e-d1ca-4d96-a852-2c4f78dc56d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:51.515374 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20db190e-d1ca-4d96-a852-2c4f78dc56d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:51.579655 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-20db190e-d1ca-4d96-a852-2c4f78dc56d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:51.593077 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-20db190e-d1ca-4d96-a852-2c4f78dc56d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1144 microversion: 2.1 time: 0.114898 Jul 26 12:57:51.594563 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 392/779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:51 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1144 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:52.320789 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8b39fb24-eb2e-4143-a51b-936539825fba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:52.321496 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8b39fb24-eb2e-4143-a51b-936539825fba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:52.327859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8b39fb24-eb2e-4143-a51b-936539825fba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:52.328298 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8b39fb24-eb2e-4143-a51b-936539825fba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:52.329065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8b39fb24-eb2e-4143-a51b-936539825fba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:52.329533 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8b39fb24-eb2e-4143-a51b-936539825fba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:52.467768 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8b39fb24-eb2e-4143-a51b-936539825fba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:52.476193 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8b39fb24-eb2e-4143-a51b-936539825fba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:52.477741 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-8b39fb24-eb2e-4143-a51b-936539825fba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:52.478903 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8b39fb24-eb2e-4143-a51b-936539825fba tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.162691 Jul 26 12:57:52.479464 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 393/780] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:52 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:57:52.497806 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9cb94ac7-0291-49dd-88a5-8b20831060fd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:52.498444 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9cb94ac7-0291-49dd-88a5-8b20831060fd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:52.504443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9cb94ac7-0291-49dd-88a5-8b20831060fd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:52.505148 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9cb94ac7-0291-49dd-88a5-8b20831060fd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:52.505915 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9cb94ac7-0291-49dd-88a5-8b20831060fd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:52.506948 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9cb94ac7-0291-49dd-88a5-8b20831060fd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:52.656087 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9cb94ac7-0291-49dd-88a5-8b20831060fd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:52.664004 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9cb94ac7-0291-49dd-88a5-8b20831060fd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.169687 Jul 26 12:57:52.664606 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 394/781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:52 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:52.669330 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-41fda377-b2c0-4d3b-acf4-d45e259cdd94 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:52.669932 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-41fda377-b2c0-4d3b-acf4-d45e259cdd94 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:52.675687 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-41fda377-b2c0-4d3b-acf4-d45e259cdd94 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:52.676147 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-41fda377-b2c0-4d3b-acf4-d45e259cdd94 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:52.676977 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-41fda377-b2c0-4d3b-acf4-d45e259cdd94 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:52.677427 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-41fda377-b2c0-4d3b-acf4-d45e259cdd94 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:52.741001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-41fda377-b2c0-4d3b-acf4-d45e259cdd94 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:52.747152 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=2 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:52.749873 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-41fda377-b2c0-4d3b-acf4-d45e259cdd94 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1144 microversion: 2.1 time: 0.084333 Jul 26 12:57:52.750443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 395/782] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:52 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:53.371070 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:53.502721 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4b48757b-b7ac-4f8a-b18f-a67be2903445 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:53.503218 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4b48757b-b7ac-4f8a-b18f-a67be2903445 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:53.506480 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=6 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:53.514106 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4b48757b-b7ac-4f8a-b18f-a67be2903445 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:53.514560 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4b48757b-b7ac-4f8a-b18f-a67be2903445 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:53.515328 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4b48757b-b7ac-4f8a-b18f-a67be2903445 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:53.515788 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4b48757b-b7ac-4f8a-b18f-a67be2903445 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:53.600410 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-61c32ebb-f0f4-4747-982d-36468aa4d039 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "POST /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.728338 Jul 26 12:57:53.601049 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 388/783] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 12:57:44 2022] POST /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments => generated 194 bytes in 8730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:53.676343 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4b48757b-b7ac-4f8a-b18f-a67be2903445 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:53.685323 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4b48757b-b7ac-4f8a-b18f-a67be2903445 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:53.686634 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c71d431a-f8c5-46ae-b00e-f2c7e804282a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:53.686876 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4b48757b-b7ac-4f8a-b18f-a67be2903445 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:53.687317 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c71d431a-f8c5-46ae-b00e-f2c7e804282a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:53.688081 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4b48757b-b7ac-4f8a-b18f-a67be2903445 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.190226 Jul 26 12:57:53.688795 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 396/784] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:53 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:53.694378 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c71d431a-f8c5-46ae-b00e-f2c7e804282a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:53.695398 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c71d431a-f8c5-46ae-b00e-f2c7e804282a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:53.696304 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c71d431a-f8c5-46ae-b00e-f2c7e804282a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:53.696734 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c71d431a-f8c5-46ae-b00e-f2c7e804282a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:53.771898 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-35de1fd8-6c7c-4d46-8145-ffc132c1c3fd tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:53.772696 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-35de1fd8-6c7c-4d46-8145-ffc132c1c3fd tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:53.779015 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35de1fd8-6c7c-4d46-8145-ffc132c1c3fd tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:53.779461 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35de1fd8-6c7c-4d46-8145-ffc132c1c3fd tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:53.780266 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35de1fd8-6c7c-4d46-8145-ffc132c1c3fd tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:53.780694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-35de1fd8-6c7c-4d46-8145-ffc132c1c3fd tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:53.833748 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c71d431a-f8c5-46ae-b00e-f2c7e804282a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:53.841855 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c71d431a-f8c5-46ae-b00e-f2c7e804282a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.159842 Jul 26 12:57:53.842441 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 389/785] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:53 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:53.843293 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-35de1fd8-6c7c-4d46-8145-ffc132c1c3fd tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:53.850716 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-35de1fd8-6c7c-4d46-8145-ffc132c1c3fd tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1192 microversion: 2.1 time: 0.082708 Jul 26 12:57:53.851806 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 397/786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:53 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:54.712439 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-06115739-20f3-46ff-8ee7-5c51e495813c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:54.714571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-06115739-20f3-46ff-8ee7-5c51e495813c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:54.724965 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-06115739-20f3-46ff-8ee7-5c51e495813c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:54.725845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-06115739-20f3-46ff-8ee7-5c51e495813c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:54.727336 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-06115739-20f3-46ff-8ee7-5c51e495813c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:54.728007 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-06115739-20f3-46ff-8ee7-5c51e495813c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:54.862472 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-605a8e96-1a65-4bda-bec9-87a628624826 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:54.863304 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-605a8e96-1a65-4bda-bec9-87a628624826 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:54.871430 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-605a8e96-1a65-4bda-bec9-87a628624826 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:54.872137 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-605a8e96-1a65-4bda-bec9-87a628624826 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:54.873105 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-605a8e96-1a65-4bda-bec9-87a628624826 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:54.873837 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-605a8e96-1a65-4bda-bec9-87a628624826 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:54.988502 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-06115739-20f3-46ff-8ee7-5c51e495813c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:54.997395 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-06115739-20f3-46ff-8ee7-5c51e495813c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:54.999090 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-06115739-20f3-46ff-8ee7-5c51e495813c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:55.000380 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-06115739-20f3-46ff-8ee7-5c51e495813c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.293582 Jul 26 12:57:55.001023 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 390/787] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:54 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:55.006184 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-872b803e-6a4b-4349-b7f9-5baaed252c84 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:55.006791 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-872b803e-6a4b-4349-b7f9-5baaed252c84 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:55.013404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-872b803e-6a4b-4349-b7f9-5baaed252c84 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:55.014081 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-872b803e-6a4b-4349-b7f9-5baaed252c84 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:55.015014 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-605a8e96-1a65-4bda-bec9-87a628624826 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:55.015285 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-872b803e-6a4b-4349-b7f9-5baaed252c84 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:55.015898 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-872b803e-6a4b-4349-b7f9-5baaed252c84 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:55.023404 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-605a8e96-1a65-4bda-bec9-87a628624826 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.164414 Jul 26 12:57:55.024253 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 398/788] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:54 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:55.220602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-872b803e-6a4b-4349-b7f9-5baaed252c84 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:55.228836 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-872b803e-6a4b-4349-b7f9-5baaed252c84 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1278 microversion: 2.1 time: 0.226607 Jul 26 12:57:55.229401 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 391/789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:55 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:55.541983 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-81ec972e-a06e-40d7-b883-a7da35296748 req-fcb2cbec-a48a-4b3d-82fd-538b3a2d1cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d1d6a8-9517-49ed-b0eb-d90086cd1783", "tag": "5d30f17c-376a-40af-aea4-819f4cd01ebc"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:55.555455 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-81ec972e-a06e-40d7-b883-a7da35296748 req-fcb2cbec-a48a-4b3d-82fd-538b3a2d1cb3 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:55.555985 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-81ec972e-a06e-40d7-b883-a7da35296748 req-fcb2cbec-a48a-4b3d-82fd-538b3a2d1cb3 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:55.584859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-81ec972e-a06e-40d7-b883-a7da35296748 req-fcb2cbec-a48a-4b3d-82fd-538b3a2d1cb3 service nova] Creating event network-changed:5d30f17c-376a-40af-aea4-819f4cd01ebc for instance 62d1d6a8-9517-49ed-b0eb-d90086cd1783 on hv-cinder-85093 Jul 26 12:57:55.594903 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-81ec972e-a06e-40d7-b883-a7da35296748 req-fcb2cbec-a48a-4b3d-82fd-538b3a2d1cb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055489 Jul 26 12:57:55.595674 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 399/790] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:56.023828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-47db9761-bea5-43a3-bd9b-9ad0a2b171aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:56.024437 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-47db9761-bea5-43a3-bd9b-9ad0a2b171aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:56.031846 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-47db9761-bea5-43a3-bd9b-9ad0a2b171aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:56.032407 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-47db9761-bea5-43a3-bd9b-9ad0a2b171aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:56.033377 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-47db9761-bea5-43a3-bd9b-9ad0a2b171aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:56.034685 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-47db9761-bea5-43a3-bd9b-9ad0a2b171aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:56.047233 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-dd107a90-7b8e-43c5-bf89-7aa32ab9a37c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:56.048620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-dd107a90-7b8e-43c5-bf89-7aa32ab9a37c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:56.056923 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dd107a90-7b8e-43c5-bf89-7aa32ab9a37c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:56.058516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dd107a90-7b8e-43c5-bf89-7aa32ab9a37c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:56.058516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dd107a90-7b8e-43c5-bf89-7aa32ab9a37c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:56.058748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dd107a90-7b8e-43c5-bf89-7aa32ab9a37c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:56.197762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-dd107a90-7b8e-43c5-bf89-7aa32ab9a37c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:56.205421 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-dd107a90-7b8e-43c5-bf89-7aa32ab9a37c tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.163242 Jul 26 12:57:56.205973 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 400/791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:56 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:56.249344 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-af53e717-bfc9-40be-ba7d-37ecf4a929fc tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:56.250011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-af53e717-bfc9-40be-ba7d-37ecf4a929fc tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:56.255231 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-47db9761-bea5-43a3-bd9b-9ad0a2b171aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:56.256554 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-af53e717-bfc9-40be-ba7d-37ecf4a929fc tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:56.257013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-af53e717-bfc9-40be-ba7d-37ecf4a929fc tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:56.257824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-af53e717-bfc9-40be-ba7d-37ecf4a929fc tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:56.258681 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-af53e717-bfc9-40be-ba7d-37ecf4a929fc tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:56.263623 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-47db9761-bea5-43a3-bd9b-9ad0a2b171aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:56.265219 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-47db9761-bea5-43a3-bd9b-9ad0a2b171aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:56.266470 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-47db9761-bea5-43a3-bd9b-9ad0a2b171aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.246623 Jul 26 12:57:56.267103 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 392/792] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:56 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:56.388716 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-af53e717-bfc9-40be-ba7d-37ecf4a929fc tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:56.397127 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-af53e717-bfc9-40be-ba7d-37ecf4a929fc tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1278 microversion: 2.1 time: 0.151755 Jul 26 12:57:56.397717 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 401/793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:56 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:57.227088 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b9367f4e-77ea-41cf-837c-b6de6b67badd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:57.227727 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b9367f4e-77ea-41cf-837c-b6de6b67badd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:57.235143 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b9367f4e-77ea-41cf-837c-b6de6b67badd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:57.235599 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b9367f4e-77ea-41cf-837c-b6de6b67badd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:57.236416 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b9367f4e-77ea-41cf-837c-b6de6b67badd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:57.236854 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b9367f4e-77ea-41cf-837c-b6de6b67badd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:57.289745 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5a141ac6-e619-4f32-b05f-9e17c52f5518 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:57.290473 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5a141ac6-e619-4f32-b05f-9e17c52f5518 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:57.297401 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5a141ac6-e619-4f32-b05f-9e17c52f5518 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:57.297928 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5a141ac6-e619-4f32-b05f-9e17c52f5518 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:57.298767 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5a141ac6-e619-4f32-b05f-9e17c52f5518 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:57.299272 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5a141ac6-e619-4f32-b05f-9e17c52f5518 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:57.380492 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-b9367f4e-77ea-41cf-837c-b6de6b67badd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:57.389611 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b9367f4e-77ea-41cf-837c-b6de6b67badd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.166300 Jul 26 12:57:57.390865 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 393/794] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:57 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:57.418349 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-88d584de-5155-4a52-9507-2d2d5df35336 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:57.419144 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-88d584de-5155-4a52-9507-2d2d5df35336 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:57.425548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-88d584de-5155-4a52-9507-2d2d5df35336 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:57.426162 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-88d584de-5155-4a52-9507-2d2d5df35336 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:57.427041 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-88d584de-5155-4a52-9507-2d2d5df35336 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:57.427673 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-88d584de-5155-4a52-9507-2d2d5df35336 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:57.441622 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5a141ac6-e619-4f32-b05f-9e17c52f5518 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:57.450664 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5a141ac6-e619-4f32-b05f-9e17c52f5518 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:57.452427 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5a141ac6-e619-4f32-b05f-9e17c52f5518 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:57.453582 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5a141ac6-e619-4f32-b05f-9e17c52f5518 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.167760 Jul 26 12:57:57.454145 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 402/795] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:57 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:57:57.563154 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-32a0b944-e16b-4c4b-84a7-55806013a225 req-ba67c56f-58ab-41df-bc44-611af3468560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146eb1e1-e26e-4f91-ad22-2cf7926f8b93", "name": "network-vif-plugged", "status": "completed", "tag": "542d7fcb-23e0-4cab-98aa-203a4db90c44"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:57:57.566087 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-88d584de-5155-4a52-9507-2d2d5df35336 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:57.573892 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-32a0b944-e16b-4c4b-84a7-55806013a225 req-ba67c56f-58ab-41df-bc44-611af3468560 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:57.574349 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-32a0b944-e16b-4c4b-84a7-55806013a225 req-ba67c56f-58ab-41df-bc44-611af3468560 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:57.574746 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-88d584de-5155-4a52-9507-2d2d5df35336 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1278 microversion: 2.1 time: 0.160209 Jul 26 12:57:57.575740 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 394/796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:57 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:57.588311 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-32a0b944-e16b-4c4b-84a7-55806013a225 req-ba67c56f-58ab-41df-bc44-611af3468560 service nova] Creating event network-vif-plugged:542d7fcb-23e0-4cab-98aa-203a4db90c44 for instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 on hv-cinder-85093 Jul 26 12:57:57.593089 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-32a0b944-e16b-4c4b-84a7-55806013a225 req-ba67c56f-58ab-41df-bc44-611af3468560 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033818 Jul 26 12:57:57.593856 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 403/797] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:57:58.124955 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1fae59b1-16fd-4554-9cbb-cbaabdeb4691 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:58.125487 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1fae59b1-16fd-4554-9cbb-cbaabdeb4691 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:58.132087 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1fae59b1-16fd-4554-9cbb-cbaabdeb4691 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:58.133191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1fae59b1-16fd-4554-9cbb-cbaabdeb4691 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:58.133964 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1fae59b1-16fd-4554-9cbb-cbaabdeb4691 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:58.134441 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1fae59b1-16fd-4554-9cbb-cbaabdeb4691 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:58.156909 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1fae59b1-16fd-4554-9cbb-cbaabdeb4691 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/ips" status: 200 len: 145 microversion: 2.1 time: 0.035888 Jul 26 12:57:58.157471 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 395/798] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Jul 26 12:57:58 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:57:58.413994 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f1884948-f1e2-43a5-bd5d-8085e29b3a27 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:58.414590 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f1884948-f1e2-43a5-bd5d-8085e29b3a27 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:58.421094 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f1884948-f1e2-43a5-bd5d-8085e29b3a27 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:58.421550 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f1884948-f1e2-43a5-bd5d-8085e29b3a27 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:58.422326 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f1884948-f1e2-43a5-bd5d-8085e29b3a27 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:58.422767 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f1884948-f1e2-43a5-bd5d-8085e29b3a27 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:58.477069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7c508a8a-a81d-424f-bfdd-d5c5d8630a5a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:58.477668 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7c508a8a-a81d-424f-bfdd-d5c5d8630a5a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:58.484219 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c508a8a-a81d-424f-bfdd-d5c5d8630a5a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:58.484668 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c508a8a-a81d-424f-bfdd-d5c5d8630a5a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:58.485436 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c508a8a-a81d-424f-bfdd-d5c5d8630a5a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:58.485874 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7c508a8a-a81d-424f-bfdd-d5c5d8630a5a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:58.560638 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f1884948-f1e2-43a5-bd5d-8085e29b3a27 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:58.568149 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f1884948-f1e2-43a5-bd5d-8085e29b3a27 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.159488 Jul 26 12:57:58.582271 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 404/799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:58 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:58.595544 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3bf8225f-1509-47ea-840f-7bdbcdd0b89d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:58.596194 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3bf8225f-1509-47ea-840f-7bdbcdd0b89d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:58.602778 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3bf8225f-1509-47ea-840f-7bdbcdd0b89d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:58.603240 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3bf8225f-1509-47ea-840f-7bdbcdd0b89d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:58.604043 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3bf8225f-1509-47ea-840f-7bdbcdd0b89d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:58.604482 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3bf8225f-1509-47ea-840f-7bdbcdd0b89d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:58.620976 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7c508a8a-a81d-424f-bfdd-d5c5d8630a5a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:58.623327 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:57:58.632108 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7c508a8a-a81d-424f-bfdd-d5c5d8630a5a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:58.633585 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7c508a8a-a81d-424f-bfdd-d5c5d8630a5a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:58.634767 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7c508a8a-a81d-424f-bfdd-d5c5d8630a5a tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.162116 Jul 26 12:57:58.635537 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 396/800] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:58 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:57:58.738726 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3bf8225f-1509-47ea-840f-7bdbcdd0b89d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:58.746179 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3bf8225f-1509-47ea-840f-7bdbcdd0b89d tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1278 microversion: 2.1 time: 0.154418 Jul 26 12:57:58.746740 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 405/801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:58 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:57:59.589846 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a134390c-8a23-4a16-8422-7a4f9a7de14d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:59.590670 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-a134390c-8a23-4a16-8422-7a4f9a7de14d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:59.598113 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a134390c-8a23-4a16-8422-7a4f9a7de14d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:59.598639 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a134390c-8a23-4a16-8422-7a4f9a7de14d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:59.599521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a134390c-8a23-4a16-8422-7a4f9a7de14d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:59.600046 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a134390c-8a23-4a16-8422-7a4f9a7de14d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:59.657924 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b43d1259-f238-4838-98d5-547f53d804a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:59.658523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b43d1259-f238-4838-98d5-547f53d804a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:59.665724 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b43d1259-f238-4838-98d5-547f53d804a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:59.666242 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b43d1259-f238-4838-98d5-547f53d804a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:59.667037 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b43d1259-f238-4838-98d5-547f53d804a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:59.667480 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b43d1259-f238-4838-98d5-547f53d804a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:59.751613 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-a134390c-8a23-4a16-8422-7a4f9a7de14d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:59.765509 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a134390c-8a23-4a16-8422-7a4f9a7de14d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.180149 Jul 26 12:57:59.780088 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 397/802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:59 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:57:59.787487 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-71fe1bfe-4f9e-4b2a-913e-eeacbaa090bb tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:57:59.788334 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-71fe1bfe-4f9e-4b2a-913e-eeacbaa090bb tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:57:59.796213 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-71fe1bfe-4f9e-4b2a-913e-eeacbaa090bb tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:59.796917 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-71fe1bfe-4f9e-4b2a-913e-eeacbaa090bb tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:59.797957 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-71fe1bfe-4f9e-4b2a-913e-eeacbaa090bb tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:57:59.798592 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-71fe1bfe-4f9e-4b2a-913e-eeacbaa090bb tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:57:59.841426 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b43d1259-f238-4838-98d5-547f53d804a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:59.849693 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b43d1259-f238-4838-98d5-547f53d804a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:59.851753 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b43d1259-f238-4838-98d5-547f53d804a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:59.853134 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b43d1259-f238-4838-98d5-547f53d804a9 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1733 microversion: 2.20 time: 0.199114 Jul 26 12:57:59.853868 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 406/803] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:57:59 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1733 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:57:59.941396 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-71fe1bfe-4f9e-4b2a-913e-eeacbaa090bb tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:57:59.948899 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-71fe1bfe-4f9e-4b2a-913e-eeacbaa090bb tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1278 microversion: 2.1 time: 0.167562 Jul 26 12:57:59.949456 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 398/804] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:57:59 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:00.581409 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-511f86d6-2594-47d9-8e84-6c3cacadccb5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b85e7ce7-dab9-48b3-948c-4746acba17e6"}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:00.583782 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-511f86d6-2594-47d9-8e84-6c3cacadccb5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:00.590493 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-511f86d6-2594-47d9-8e84-6c3cacadccb5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:00.590942 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-511f86d6-2594-47d9-8e84-6c3cacadccb5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:00.591742 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-511f86d6-2594-47d9-8e84-6c3cacadccb5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:00.592179 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-511f86d6-2594-47d9-8e84-6c3cacadccb5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:00.715502 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:00.792119 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e5494740-1752-47b6-9c1f-bf1aa4173d58 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:00.792858 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e5494740-1752-47b6-9c1f-bf1aa4173d58 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:00.799534 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e5494740-1752-47b6-9c1f-bf1aa4173d58 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:00.800024 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e5494740-1752-47b6-9c1f-bf1aa4173d58 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:00.800827 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e5494740-1752-47b6-9c1f-bf1aa4173d58 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:00.801258 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e5494740-1752-47b6-9c1f-bf1aa4173d58 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:00.838425 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-511f86d6-2594-47d9-8e84-6c3cacadccb5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "POST /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261220 Jul 26 12:58:00.839058 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 407/805] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 12:58:00 2022] POST /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:00.877700 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-585e8602-d603-4446-9ecd-746614dc74b0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:00.878416 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-585e8602-d603-4446-9ecd-746614dc74b0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:00.887087 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-585e8602-d603-4446-9ecd-746614dc74b0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:00.887552 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-585e8602-d603-4446-9ecd-746614dc74b0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:00.888603 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-585e8602-d603-4446-9ecd-746614dc74b0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:00.889056 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-585e8602-d603-4446-9ecd-746614dc74b0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:00.948345 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e5494740-1752-47b6-9c1f-bf1aa4173d58 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:00.956191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e5494740-1752-47b6-9c1f-bf1aa4173d58 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.168463 Jul 26 12:58:00.956803 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 399/806] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:00 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:58:00.972777 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-97758a73-204b-43b5-8d60-30b734006351 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:00.973389 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-97758a73-204b-43b5-8d60-30b734006351 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:00.979811 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-97758a73-204b-43b5-8d60-30b734006351 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:00.980244 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-97758a73-204b-43b5-8d60-30b734006351 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:00.981197 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-97758a73-204b-43b5-8d60-30b734006351 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:00.981662 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-97758a73-204b-43b5-8d60-30b734006351 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:01.037718 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-585e8602-d603-4446-9ecd-746614dc74b0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:01.047339 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-585e8602-d603-4446-9ecd-746614dc74b0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:01.049012 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-585e8602-d603-4446-9ecd-746614dc74b0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:01.050268 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-585e8602-d603-4446-9ecd-746614dc74b0 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1720 microversion: 2.20 time: 0.177179 Jul 26 12:58:01.050900 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 408/807] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:58:00 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:58:01.124003 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-97758a73-204b-43b5-8d60-30b734006351 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:01.132195 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-97758a73-204b-43b5-8d60-30b734006351 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1266 microversion: 2.1 time: 0.163096 Jul 26 12:58:01.143836 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 400/808] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:00 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:01.299891 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9a5226a5-4abd-4fe4-a208-0957096d04d0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:01.300325 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9a5226a5-4abd-4fe4-a208-0957096d04d0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:01.307488 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9a5226a5-4abd-4fe4-a208-0957096d04d0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:01.308046 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9a5226a5-4abd-4fe4-a208-0957096d04d0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:01.308806 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9a5226a5-4abd-4fe4-a208-0957096d04d0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:01.309244 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9a5226a5-4abd-4fe4-a208-0957096d04d0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:01.392904 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-9a5226a5-4abd-4fe4-a208-0957096d04d0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lazy-loading 'services' on Instance uuid 6b9e8067-dd21-438b-997e-100b012cd6f0 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:58:01.469838 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9a5226a5-4abd-4fe4-a208-0957096d04d0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments/0a9261bb-f60d-4fd5-8632-b22e1d883890" status: 202 len: 0 microversion: 2.1 time: 0.173691 Jul 26 12:58:01.470466 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 409/809] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Jul 26 12:58:01 2022] DELETE /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments/0a9261bb-f60d-4fd5-8632-b22e1d883890 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:58:01.479436 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c85d1829-3f9c-490c-8843-35a7083768d3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:01.481787 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c85d1829-3f9c-490c-8843-35a7083768d3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:01.488012 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c85d1829-3f9c-490c-8843-35a7083768d3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:01.488493 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c85d1829-3f9c-490c-8843-35a7083768d3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:01.489327 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c85d1829-3f9c-490c-8843-35a7083768d3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:01.489800 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c85d1829-3f9c-490c-8843-35a7083768d3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:01.521669 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c85d1829-3f9c-490c-8843-35a7083768d3 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046626 Jul 26 12:58:01.522092 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 401/810] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:58:01 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:01.978154 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c2dca16e-8d53-42d5-a107-7406220ab2a3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:01.978859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c2dca16e-8d53-42d5-a107-7406220ab2a3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:01.985170 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c2dca16e-8d53-42d5-a107-7406220ab2a3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:01.985627 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c2dca16e-8d53-42d5-a107-7406220ab2a3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:01.986396 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c2dca16e-8d53-42d5-a107-7406220ab2a3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:01.986839 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c2dca16e-8d53-42d5-a107-7406220ab2a3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:02.129991 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c2dca16e-8d53-42d5-a107-7406220ab2a3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:02.137806 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c2dca16e-8d53-42d5-a107-7406220ab2a3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.164367 Jul 26 12:58:02.138384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 410/811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:01 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:02.153516 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-91cbd2e4-9f5d-4584-aafe-ae153f0706a9 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:02.154118 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-91cbd2e4-9f5d-4584-aafe-ae153f0706a9 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:02.160616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-91cbd2e4-9f5d-4584-aafe-ae153f0706a9 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:02.161068 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-91cbd2e4-9f5d-4584-aafe-ae153f0706a9 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:02.161832 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-91cbd2e4-9f5d-4584-aafe-ae153f0706a9 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:02.162267 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-91cbd2e4-9f5d-4584-aafe-ae153f0706a9 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:02.296476 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-91cbd2e4-9f5d-4584-aafe-ae153f0706a9 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:02.303935 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-91cbd2e4-9f5d-4584-aafe-ae153f0706a9 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1266 microversion: 2.1 time: 0.154213 Jul 26 12:58:02.305083 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 402/812] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:02 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:02.534100 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-dc909085-e15d-40dc-b462-4ffba6166e80 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:02.536372 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-dc909085-e15d-40dc-b462-4ffba6166e80 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:02.543144 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc909085-e15d-40dc-b462-4ffba6166e80 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:02.543593 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc909085-e15d-40dc-b462-4ffba6166e80 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:02.544388 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc909085-e15d-40dc-b462-4ffba6166e80 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:02.544835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-dc909085-e15d-40dc-b462-4ffba6166e80 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:02.573291 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-dc909085-e15d-40dc-b462-4ffba6166e80 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043149 Jul 26 12:58:02.573767 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 411/813] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:58:02 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:03.158726 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-83df472e-fdb1-402e-929a-7d424a280bf0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:03.159401 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-83df472e-fdb1-402e-929a-7d424a280bf0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:03.165917 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-83df472e-fdb1-402e-929a-7d424a280bf0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:03.166367 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-83df472e-fdb1-402e-929a-7d424a280bf0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:03.167144 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-83df472e-fdb1-402e-929a-7d424a280bf0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:03.167583 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-83df472e-fdb1-402e-929a-7d424a280bf0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:03.297645 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-83df472e-fdb1-402e-929a-7d424a280bf0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:03.305631 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-83df472e-fdb1-402e-929a-7d424a280bf0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.150751 Jul 26 12:58:03.306183 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 403/814] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:03 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:03.325631 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-52704809-754b-48ad-842e-2dbaf1d1da50 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:03.326239 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-52704809-754b-48ad-842e-2dbaf1d1da50 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:03.332599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-52704809-754b-48ad-842e-2dbaf1d1da50 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:03.333049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-52704809-754b-48ad-842e-2dbaf1d1da50 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:03.333803 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-52704809-754b-48ad-842e-2dbaf1d1da50 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:03.334236 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-52704809-754b-48ad-842e-2dbaf1d1da50 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:03.468495 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-52704809-754b-48ad-842e-2dbaf1d1da50 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:03.475938 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-52704809-754b-48ad-842e-2dbaf1d1da50 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1266 microversion: 2.1 time: 0.154082 Jul 26 12:58:03.476682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 412/815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:03 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:03.585683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0f035541-905d-4239-977c-496ee31948b8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:03.587833 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0f035541-905d-4239-977c-496ee31948b8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:03.593867 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0f035541-905d-4239-977c-496ee31948b8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:03.594314 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0f035541-905d-4239-977c-496ee31948b8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:03.595066 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0f035541-905d-4239-977c-496ee31948b8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:03.595499 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0f035541-905d-4239-977c-496ee31948b8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:03.626695 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0f035541-905d-4239-977c-496ee31948b8 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045036 Jul 26 12:58:03.627444 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 404/816] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:58:03 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:04.326742 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5f7d88af-7c6e-4c26-a7ef-6ee22b3b2731 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:04.327283 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5f7d88af-7c6e-4c26-a7ef-6ee22b3b2731 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:04.333921 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5f7d88af-7c6e-4c26-a7ef-6ee22b3b2731 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:04.334380 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5f7d88af-7c6e-4c26-a7ef-6ee22b3b2731 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:04.335268 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5f7d88af-7c6e-4c26-a7ef-6ee22b3b2731 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:04.336232 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5f7d88af-7c6e-4c26-a7ef-6ee22b3b2731 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:04.469580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5f7d88af-7c6e-4c26-a7ef-6ee22b3b2731 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:04.477021 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5f7d88af-7c6e-4c26-a7ef-6ee22b3b2731 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.154192 Jul 26 12:58:04.477585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 413/817] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:04 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:04.496812 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-858f734a-2727-4c8b-855b-0aee43eb8faf tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:04.497424 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-858f734a-2727-4c8b-855b-0aee43eb8faf tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:04.503891 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-858f734a-2727-4c8b-855b-0aee43eb8faf tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:04.504349 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-858f734a-2727-4c8b-855b-0aee43eb8faf tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:04.505373 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-858f734a-2727-4c8b-855b-0aee43eb8faf tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:04.505815 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-858f734a-2727-4c8b-855b-0aee43eb8faf tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:04.639616 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1910e867-3730-4053-8e61-dee13c2b08f4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:04.640060 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-858f734a-2727-4c8b-855b-0aee43eb8faf tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:04.641975 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1910e867-3730-4053-8e61-dee13c2b08f4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:04.643871 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:04.648354 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-858f734a-2727-4c8b-855b-0aee43eb8faf tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1266 microversion: 2.1 time: 0.155280 Jul 26 12:58:04.648933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 405/818] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:04 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:04.649281 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1910e867-3730-4053-8e61-dee13c2b08f4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:04.649737 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1910e867-3730-4053-8e61-dee13c2b08f4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:04.650517 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1910e867-3730-4053-8e61-dee13c2b08f4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:04.650955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1910e867-3730-4053-8e61-dee13c2b08f4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:04.682634 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1910e867-3730-4053-8e61-dee13c2b08f4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046985 Jul 26 12:58:04.683203 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 414/819] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:58:04 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:05.497764 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6f6fc506-f065-4a72-bb36-ef7fb665fb4d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:05.498367 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6f6fc506-f065-4a72-bb36-ef7fb665fb4d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:05.504898 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6f6fc506-f065-4a72-bb36-ef7fb665fb4d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:05.505616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6f6fc506-f065-4a72-bb36-ef7fb665fb4d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:05.506376 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6f6fc506-f065-4a72-bb36-ef7fb665fb4d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:05.506811 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6f6fc506-f065-4a72-bb36-ef7fb665fb4d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:05.638067 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6f6fc506-f065-4a72-bb36-ef7fb665fb4d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:05.645752 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6f6fc506-f065-4a72-bb36-ef7fb665fb4d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.151835 Jul 26 12:58:05.646458 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 406/820] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:05 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:05.670204 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-336e3cf1-cbf7-403b-8b17-ce7f2e2f2311 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:05.670809 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-336e3cf1-cbf7-403b-8b17-ce7f2e2f2311 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:05.677320 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-336e3cf1-cbf7-403b-8b17-ce7f2e2f2311 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:05.677767 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-336e3cf1-cbf7-403b-8b17-ce7f2e2f2311 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:05.678527 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-336e3cf1-cbf7-403b-8b17-ce7f2e2f2311 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:05.679500 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-336e3cf1-cbf7-403b-8b17-ce7f2e2f2311 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:05.698106 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-bae14418-d9c4-42d7-9bfb-a7da125cccb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:05.700493 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-bae14418-d9c4-42d7-9bfb-a7da125cccb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:05.706566 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bae14418-d9c4-42d7-9bfb-a7da125cccb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:05.707009 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bae14418-d9c4-42d7-9bfb-a7da125cccb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:05.707813 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bae14418-d9c4-42d7-9bfb-a7da125cccb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:05.708252 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bae14418-d9c4-42d7-9bfb-a7da125cccb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:05.746713 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-bae14418-d9c4-42d7-9bfb-a7da125cccb5 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055847 Jul 26 12:58:05.747311 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 407/821] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:58:05 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:58:05.816057 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-336e3cf1-cbf7-403b-8b17-ce7f2e2f2311 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:05.823424 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-336e3cf1-cbf7-403b-8b17-ce7f2e2f2311 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1266 microversion: 2.1 time: 0.157063 Jul 26 12:58:05.824104 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 415/822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:05 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:06.666337 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-62577176-0496-4890-a7d3-78c6a1212c5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:06.666921 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-62577176-0496-4890-a7d3-78c6a1212c5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:06.673366 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-62577176-0496-4890-a7d3-78c6a1212c5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:06.673807 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-62577176-0496-4890-a7d3-78c6a1212c5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:06.674555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-62577176-0496-4890-a7d3-78c6a1212c5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:06.674985 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-62577176-0496-4890-a7d3-78c6a1212c5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:06.759230 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b0b541ff-36c7-44bc-bd88-530e34e25e3c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:06.761404 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b0b541ff-36c7-44bc-bd88-530e34e25e3c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:06.768069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b0b541ff-36c7-44bc-bd88-530e34e25e3c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:06.768514 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b0b541ff-36c7-44bc-bd88-530e34e25e3c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:06.769285 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b0b541ff-36c7-44bc-bd88-530e34e25e3c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:06.769721 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b0b541ff-36c7-44bc-bd88-530e34e25e3c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:06.799453 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b0b541ff-36c7-44bc-bd88-530e34e25e3c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Jul 26 12:58:06.800371 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 416/823] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:58:06 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:58:06.805181 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-62577176-0496-4890-a7d3-78c6a1212c5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:06.812605 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-62577176-0496-4890-a7d3-78c6a1212c5b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.150108 Jul 26 12:58:06.813157 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 408/824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:06 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:06.843769 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9a7f96c3-8e7e-4ce9-ad9e-7d54b18b59d6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:06.844428 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9a7f96c3-8e7e-4ce9-ad9e-7d54b18b59d6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:06.850302 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9a7f96c3-8e7e-4ce9-ad9e-7d54b18b59d6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:06.850748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9a7f96c3-8e7e-4ce9-ad9e-7d54b18b59d6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:06.851497 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9a7f96c3-8e7e-4ce9-ad9e-7d54b18b59d6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:06.851963 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9a7f96c3-8e7e-4ce9-ad9e-7d54b18b59d6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:06.988350 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9a7f96c3-8e7e-4ce9-ad9e-7d54b18b59d6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:06.996624 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9a7f96c3-8e7e-4ce9-ad9e-7d54b18b59d6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1266 microversion: 2.1 time: 0.156614 Jul 26 12:58:06.997209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 417/825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:06 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:07.811900 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a0a522f3-fdf5-4251-9139-29dfc63de716 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:07.814802 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-a0a522f3-fdf5-4251-9139-29dfc63de716 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:07.822144 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a0a522f3-fdf5-4251-9139-29dfc63de716 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:07.822594 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a0a522f3-fdf5-4251-9139-29dfc63de716 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:07.823366 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a0a522f3-fdf5-4251-9139-29dfc63de716 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:07.823837 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a0a522f3-fdf5-4251-9139-29dfc63de716 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:07.833857 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4a31a37e-ff8e-422b-86bd-800a82b5cbe6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:07.834474 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4a31a37e-ff8e-422b-86bd-800a82b5cbe6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:07.841182 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4a31a37e-ff8e-422b-86bd-800a82b5cbe6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:07.841638 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4a31a37e-ff8e-422b-86bd-800a82b5cbe6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:07.842405 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4a31a37e-ff8e-422b-86bd-800a82b5cbe6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:07.842845 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4a31a37e-ff8e-422b-86bd-800a82b5cbe6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:07.853205 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a0a522f3-fdf5-4251-9139-29dfc63de716 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045389 Jul 26 12:58:07.853883 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 409/826] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:58:07 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:08.018335 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3e31be5c-d8a7-418c-9d6f-6bcde87c8717 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:08.018939 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3e31be5c-d8a7-418c-9d6f-6bcde87c8717 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:08.025022 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3e31be5c-d8a7-418c-9d6f-6bcde87c8717 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:08.025742 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3e31be5c-d8a7-418c-9d6f-6bcde87c8717 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:08.026558 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3e31be5c-d8a7-418c-9d6f-6bcde87c8717 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:08.026998 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3e31be5c-d8a7-418c-9d6f-6bcde87c8717 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:08.144579 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4a31a37e-ff8e-422b-86bd-800a82b5cbe6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:08.158269 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4a31a37e-ff8e-422b-86bd-800a82b5cbe6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.327958 Jul 26 12:58:08.159398 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 418/827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:07 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:58:08.196683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3e31be5c-d8a7-418c-9d6f-6bcde87c8717 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:08.204256 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3e31be5c-d8a7-418c-9d6f-6bcde87c8717 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1266 microversion: 2.1 time: 0.189719 Jul 26 12:58:08.204834 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 410/828] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:08 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:58:08.375962 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-81439843-6a4e-4b0c-9c36-bb2b845f5a96 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:08.382313 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-81439843-6a4e-4b0c-9c36-bb2b845f5a96 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:08.382771 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-81439843-6a4e-4b0c-9c36-bb2b845f5a96 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:08.441618 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-81439843-6a4e-4b0c-9c36-bb2b845f5a96 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Going to try to stop instance {{(pid=129307) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 12:58:08.484178 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-81439843-6a4e-4b0c-9c36-bb2b845f5a96 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "POST /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/action" status: 202 len: 0 microversion: 2.1 time: 0.112059 Jul 26 12:58:08.484794 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 419/829] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 12:58:08 2022] POST /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:58:08.492805 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-4aff377e-f115-491f-8b1a-e021ba1b2243 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:08.493416 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-4aff377e-f115-491f-8b1a-e021ba1b2243 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:08.499430 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4aff377e-f115-491f-8b1a-e021ba1b2243 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:08.499928 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4aff377e-f115-491f-8b1a-e021ba1b2243 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:08.500693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4aff377e-f115-491f-8b1a-e021ba1b2243 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:08.501147 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4aff377e-f115-491f-8b1a-e021ba1b2243 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:08.737238 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-4aff377e-f115-491f-8b1a-e021ba1b2243 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:08.746126 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-4aff377e-f115-491f-8b1a-e021ba1b2243 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.257077 Jul 26 12:58:08.746693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 411/830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:08 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:08.867422 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8500034a-b85f-4b95-92ca-06b540d05707 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:08.869666 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8500034a-b85f-4b95-92ca-06b540d05707 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:08.875948 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8500034a-b85f-4b95-92ca-06b540d05707 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:08.876400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8500034a-b85f-4b95-92ca-06b540d05707 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:08.877166 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8500034a-b85f-4b95-92ca-06b540d05707 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:08.877594 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8500034a-b85f-4b95-92ca-06b540d05707 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:08.908291 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8500034a-b85f-4b95-92ca-06b540d05707 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046208 Jul 26 12:58:08.909033 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 420/831] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 12:58:08 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 12:58:08.970994 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e3d8996c-cc32-47ac-9a23-54fee1da54ad tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:08.971557 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e3d8996c-cc32-47ac-9a23-54fee1da54ad tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:08.978419 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e3d8996c-cc32-47ac-9a23-54fee1da54ad tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:08.978871 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e3d8996c-cc32-47ac-9a23-54fee1da54ad tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:08.979660 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e3d8996c-cc32-47ac-9a23-54fee1da54ad tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:08.980100 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e3d8996c-cc32-47ac-9a23-54fee1da54ad tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:09.008000 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e3d8996c-cc32-47ac-9a23-54fee1da54ad tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Going to try to terminate instance {{(pid=129308) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:58:09.032064 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=100 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:09.086949 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e3d8996c-cc32-47ac-9a23-54fee1da54ad tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 204 len: 0 microversion: 2.1 time: 0.119503 Jul 26 12:58:09.087943 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 412/832] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:58:08 2022] DELETE /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:58:09.096284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c3eafc4c-3c91-4ecc-9779-005bbe76ecc1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:09.096905 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c3eafc4c-3c91-4ecc-9779-005bbe76ecc1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:09.102930 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c3eafc4c-3c91-4ecc-9779-005bbe76ecc1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:09.103380 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c3eafc4c-3c91-4ecc-9779-005bbe76ecc1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:09.104168 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c3eafc4c-3c91-4ecc-9779-005bbe76ecc1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:09.104620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c3eafc4c-3c91-4ecc-9779-005bbe76ecc1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:09.186047 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-0251a6cc-f735-4779-8d0f-1373c1874bd6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:09.186918 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-0251a6cc-f735-4779-8d0f-1373c1874bd6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:09.193122 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0251a6cc-f735-4779-8d0f-1373c1874bd6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:09.193575 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0251a6cc-f735-4779-8d0f-1373c1874bd6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:09.194365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0251a6cc-f735-4779-8d0f-1373c1874bd6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:09.195427 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-0251a6cc-f735-4779-8d0f-1373c1874bd6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:09.236294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c3eafc4c-3c91-4ecc-9779-005bbe76ecc1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:09.239941 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:09.245519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c3eafc4c-3c91-4ecc-9779-005bbe76ecc1 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 200 len: 1680 microversion: 2.1 time: 0.153232 Jul 26 12:58:09.246434 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 421/833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:09 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:09.251160 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f8a33228-8297-4ef9-9698-c45f2e79f58e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:09.251820 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f8a33228-8297-4ef9-9698-c45f2e79f58e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:09.259768 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f8a33228-8297-4ef9-9698-c45f2e79f58e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:09.260272 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f8a33228-8297-4ef9-9698-c45f2e79f58e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:09.261152 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f8a33228-8297-4ef9-9698-c45f2e79f58e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:09.261663 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f8a33228-8297-4ef9-9698-c45f2e79f58e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:09.336873 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-0251a6cc-f735-4779-8d0f-1373c1874bd6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:09.344665 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-0251a6cc-f735-4779-8d0f-1373c1874bd6 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.163053 Jul 26 12:58:09.345434 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 413/834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:09 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:09.402814 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f8a33228-8297-4ef9-9698-c45f2e79f58e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:09.410209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f8a33228-8297-4ef9-9698-c45f2e79f58e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1266 microversion: 2.1 time: 0.163085 Jul 26 12:58:09.410764 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 422/835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:09 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:09.638033 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-1ffcd43e-511d-454a-a88d-511bf49b7b92 req-52feacfb-a6e2-41a9-a4ba-586b616403f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d1d6a8-9517-49ed-b0eb-d90086cd1783", "name": "network-vif-plugged", "status": "completed", "tag": "5d30f17c-376a-40af-aea4-819f4cd01ebc"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:09.648047 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-1ffcd43e-511d-454a-a88d-511bf49b7b92 req-52feacfb-a6e2-41a9-a4ba-586b616403f1 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:09.648501 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-1ffcd43e-511d-454a-a88d-511bf49b7b92 req-52feacfb-a6e2-41a9-a4ba-586b616403f1 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:09.659879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-1ffcd43e-511d-454a-a88d-511bf49b7b92 req-52feacfb-a6e2-41a9-a4ba-586b616403f1 service nova] Creating event network-vif-plugged:5d30f17c-376a-40af-aea4-819f4cd01ebc for instance 62d1d6a8-9517-49ed-b0eb-d90086cd1783 on hv-cinder-85093 Jul 26 12:58:09.665120 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-1ffcd43e-511d-454a-a88d-511bf49b7b92 req-52feacfb-a6e2-41a9-a4ba-586b616403f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030730 Jul 26 12:58:09.665708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 414/836] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:09.768682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-41be6605-3c21-436d-a6ad-2ae5983d5c68 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:09.769268 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-41be6605-3c21-436d-a6ad-2ae5983d5c68 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:09.775425 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-41be6605-3c21-436d-a6ad-2ae5983d5c68 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:09.775908 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-41be6605-3c21-436d-a6ad-2ae5983d5c68 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:09.776677 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-41be6605-3c21-436d-a6ad-2ae5983d5c68 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:09.777112 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-41be6605-3c21-436d-a6ad-2ae5983d5c68 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:09.912137 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-41be6605-3c21-436d-a6ad-2ae5983d5c68 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:09.921095 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-41be6605-3c21-436d-a6ad-2ae5983d5c68 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.156524 Jul 26 12:58:09.921661 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 423/837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:09 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:10.268134 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8b074324-5d2b-43ea-b8e3-b3dae4df9dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:10.268818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8b074324-5d2b-43ea-b8e3-b3dae4df9dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:10.275819 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8b074324-5d2b-43ea-b8e3-b3dae4df9dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:10.276255 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8b074324-5d2b-43ea-b8e3-b3dae4df9dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:10.277017 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8b074324-5d2b-43ea-b8e3-b3dae4df9dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:10.277489 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8b074324-5d2b-43ea-b8e3-b3dae4df9dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:10.365626 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-a8076f0f-2aa4-49f6-a470-a47864329d76 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:10.366320 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-a8076f0f-2aa4-49f6-a470-a47864329d76 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:10.372484 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a8076f0f-2aa4-49f6-a470-a47864329d76 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:10.372931 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a8076f0f-2aa4-49f6-a470-a47864329d76 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:10.373709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a8076f0f-2aa4-49f6-a470-a47864329d76 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:10.374123 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a8076f0f-2aa4-49f6-a470-a47864329d76 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:10.410712 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8b074324-5d2b-43ea-b8e3-b3dae4df9dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:10.418929 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8b074324-5d2b-43ea-b8e3-b3dae4df9dab tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 200 len: 1680 microversion: 2.1 time: 0.155283 Jul 26 12:58:10.419512 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 415/838] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:10 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:10.430903 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c254fb4e-672f-490a-8e55-8f3852916e6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:10.431466 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c254fb4e-672f-490a-8e55-8f3852916e6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:10.438266 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c254fb4e-672f-490a-8e55-8f3852916e6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:10.438719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c254fb4e-672f-490a-8e55-8f3852916e6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:10.439494 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c254fb4e-672f-490a-8e55-8f3852916e6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:10.439961 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c254fb4e-672f-490a-8e55-8f3852916e6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:10.517652 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-a8076f0f-2aa4-49f6-a470-a47864329d76 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:10.526152 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-a8076f0f-2aa4-49f6-a470-a47864329d76 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.164294 Jul 26 12:58:10.526809 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 424/839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:10 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:10.576869 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c254fb4e-672f-490a-8e55-8f3852916e6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:10.585787 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c254fb4e-672f-490a-8e55-8f3852916e6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1266 microversion: 2.1 time: 0.158236 Jul 26 12:58:10.586395 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 416/840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:10 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:10.942594 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-49ad97dc-ca27-4e2d-acdb-1c7db80c361b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:10.943213 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-49ad97dc-ca27-4e2d-acdb-1c7db80c361b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:10.949885 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-49ad97dc-ca27-4e2d-acdb-1c7db80c361b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:10.950341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-49ad97dc-ca27-4e2d-acdb-1c7db80c361b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:10.951111 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-49ad97dc-ca27-4e2d-acdb-1c7db80c361b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:10.951557 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-49ad97dc-ca27-4e2d-acdb-1c7db80c361b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:11.087834 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-49ad97dc-ca27-4e2d-acdb-1c7db80c361b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:11.096050 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-49ad97dc-ca27-4e2d-acdb-1c7db80c361b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.157401 Jul 26 12:58:11.096620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 425/841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:10 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:11.440824 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-efcce6b4-50f2-404d-94ae-939244a1dabd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:11.441435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-efcce6b4-50f2-404d-94ae-939244a1dabd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:11.448586 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-efcce6b4-50f2-404d-94ae-939244a1dabd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:11.449035 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-efcce6b4-50f2-404d-94ae-939244a1dabd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:11.449806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-efcce6b4-50f2-404d-94ae-939244a1dabd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:11.450249 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-efcce6b4-50f2-404d-94ae-939244a1dabd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:11.546819 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-04dfc2c2-4d29-4054-93c2-3d2bded9ac91 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:11.547487 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-04dfc2c2-4d29-4054-93c2-3d2bded9ac91 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:11.554262 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-04dfc2c2-4d29-4054-93c2-3d2bded9ac91 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:11.554722 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-04dfc2c2-4d29-4054-93c2-3d2bded9ac91 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:11.555740 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-04dfc2c2-4d29-4054-93c2-3d2bded9ac91 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:11.556186 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-04dfc2c2-4d29-4054-93c2-3d2bded9ac91 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:11.581633 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-efcce6b4-50f2-404d-94ae-939244a1dabd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:11.589464 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-efcce6b4-50f2-404d-94ae-939244a1dabd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 200 len: 1680 microversion: 2.1 time: 0.152378 Jul 26 12:58:11.589941 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 417/842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:11 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:11.606203 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9f74bd84-1d21-493f-baf1-058c15526ce8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:11.606803 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-9f74bd84-1d21-493f-baf1-058c15526ce8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:11.612858 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9f74bd84-1d21-493f-baf1-058c15526ce8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:11.613307 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9f74bd84-1d21-493f-baf1-058c15526ce8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:11.614079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9f74bd84-1d21-493f-baf1-058c15526ce8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:11.614483 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9f74bd84-1d21-493f-baf1-058c15526ce8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:11.693234 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-04dfc2c2-4d29-4054-93c2-3d2bded9ac91 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:11.702068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-04dfc2c2-4d29-4054-93c2-3d2bded9ac91 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.159024 Jul 26 12:58:11.702671 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 426/843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:11 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:58:11.753438 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-9f74bd84-1d21-493f-baf1-058c15526ce8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:11.761880 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9f74bd84-1d21-493f-baf1-058c15526ce8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1266 microversion: 2.1 time: 0.159433 Jul 26 12:58:11.762450 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 418/844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:11 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:12.120670 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-06b6b6c2-b508-4d76-bfc0-55f021648ae1 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:12.121285 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-06b6b6c2-b508-4d76-bfc0-55f021648ae1 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:12.128107 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-06b6b6c2-b508-4d76-bfc0-55f021648ae1 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:12.128561 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-06b6b6c2-b508-4d76-bfc0-55f021648ae1 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:12.129365 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-06b6b6c2-b508-4d76-bfc0-55f021648ae1 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:12.129801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-06b6b6c2-b508-4d76-bfc0-55f021648ae1 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:12.268202 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-06b6b6c2-b508-4d76-bfc0-55f021648ae1 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:12.276261 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-06b6b6c2-b508-4d76-bfc0-55f021648ae1 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.160045 Jul 26 12:58:12.276908 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 427/845] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:12 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:58:12.610534 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b1017ac6-dd9e-40d7-82cb-f4eed59c58a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:12.611165 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b1017ac6-dd9e-40d7-82cb-f4eed59c58a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:12.613782 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:12.620263 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b1017ac6-dd9e-40d7-82cb-f4eed59c58a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:12.620720 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b1017ac6-dd9e-40d7-82cb-f4eed59c58a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:12.621507 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b1017ac6-dd9e-40d7-82cb-f4eed59c58a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:12.621944 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b1017ac6-dd9e-40d7-82cb-f4eed59c58a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:12.723330 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-22276ecb-772b-48d1-bf3a-0e07bfb30924 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:12.723977 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-22276ecb-772b-48d1-bf3a-0e07bfb30924 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:12.732038 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-22276ecb-772b-48d1-bf3a-0e07bfb30924 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:12.732491 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-22276ecb-772b-48d1-bf3a-0e07bfb30924 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:12.733266 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-22276ecb-772b-48d1-bf3a-0e07bfb30924 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:12.733705 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-22276ecb-772b-48d1-bf3a-0e07bfb30924 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:12.872798 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-b1017ac6-dd9e-40d7-82cb-f4eed59c58a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:12.878908 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-22276ecb-772b-48d1-bf3a-0e07bfb30924 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:12.882689 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b1017ac6-dd9e-40d7-82cb-f4eed59c58a4 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 200 len: 1680 microversion: 2.1 time: 0.276055 Jul 26 12:58:12.883329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 419/846] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:12 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 1680 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:12.887280 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-22276ecb-772b-48d1-bf3a-0e07bfb30924 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.167746 Jul 26 12:58:12.887876 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 428/847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:12 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:58:12.889034 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8bfcf0f1-d5b2-4d15-b2d5-1ecae137af0e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:12.890234 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8bfcf0f1-d5b2-4d15-b2d5-1ecae137af0e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:12.906742 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8bfcf0f1-d5b2-4d15-b2d5-1ecae137af0e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:12.907187 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8bfcf0f1-d5b2-4d15-b2d5-1ecae137af0e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:12.908076 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8bfcf0f1-d5b2-4d15-b2d5-1ecae137af0e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:12.908526 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8bfcf0f1-d5b2-4d15-b2d5-1ecae137af0e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:13.122186 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8bfcf0f1-d5b2-4d15-b2d5-1ecae137af0e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:13.133127 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8bfcf0f1-d5b2-4d15-b2d5-1ecae137af0e tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1266 microversion: 2.1 time: 0.248709 Jul 26 12:58:13.134091 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 420/848] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:12 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:13.298507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2217cb54-55a7-4e76-90e5-e5f364b30749 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:13.299142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2217cb54-55a7-4e76-90e5-e5f364b30749 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:13.307008 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2217cb54-55a7-4e76-90e5-e5f364b30749 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:13.307601 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2217cb54-55a7-4e76-90e5-e5f364b30749 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:13.308658 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2217cb54-55a7-4e76-90e5-e5f364b30749 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:13.309159 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2217cb54-55a7-4e76-90e5-e5f364b30749 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:13.446862 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2217cb54-55a7-4e76-90e5-e5f364b30749 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:13.455572 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2217cb54-55a7-4e76-90e5-e5f364b30749 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.161004 Jul 26 12:58:13.456443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 429/849] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:13 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:13.684424 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-8915123c-6052-49e1-8c15-4b90dbbe8b94 req-932b68cc-cbe2-496b-98d8-7d5f8687e857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b9e8067-dd21-438b-997e-100b012cd6f0", "name": "network-vif-deleted", "tag": "f8c8c0ab-fac0-4f1a-8802-3cb64df470f6"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:13.695866 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-8915123c-6052-49e1-8c15-4b90dbbe8b94 req-932b68cc-cbe2-496b-98d8-7d5f8687e857 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:13.696306 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-8915123c-6052-49e1-8c15-4b90dbbe8b94 req-932b68cc-cbe2-496b-98d8-7d5f8687e857 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:13.708578 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-8915123c-6052-49e1-8c15-4b90dbbe8b94 req-932b68cc-cbe2-496b-98d8-7d5f8687e857 service nova] Creating event network-vif-deleted:f8c8c0ab-fac0-4f1a-8802-3cb64df470f6 for instance 6b9e8067-dd21-438b-997e-100b012cd6f0 on hv-cinder-85093 Jul 26 12:58:13.714427 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-8915123c-6052-49e1-8c15-4b90dbbe8b94 req-932b68cc-cbe2-496b-98d8-7d5f8687e857 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033593 Jul 26 12:58:13.715061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 421/850] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:13.908004 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-280dcebd-5c03-40bb-b391-24fb0bd7f622 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:13.909047 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-280dcebd-5c03-40bb-b391-24fb0bd7f622 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:13.910588 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-46ad2bb9-6b7d-43fb-9535-1f8bb31bdda7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:13.911683 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-46ad2bb9-6b7d-43fb-9535-1f8bb31bdda7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:13.918317 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-46ad2bb9-6b7d-43fb-9535-1f8bb31bdda7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:13.918845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-46ad2bb9-6b7d-43fb-9535-1f8bb31bdda7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:13.919743 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-46ad2bb9-6b7d-43fb-9535-1f8bb31bdda7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:13.920280 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-46ad2bb9-6b7d-43fb-9535-1f8bb31bdda7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:13.920394 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-280dcebd-5c03-40bb-b391-24fb0bd7f622 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:13.921132 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-280dcebd-5c03-40bb-b391-24fb0bd7f622 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:13.922528 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-280dcebd-5c03-40bb-b391-24fb0bd7f622 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:13.923553 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-280dcebd-5c03-40bb-b391-24fb0bd7f622 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:14.016795 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-280dcebd-5c03-40bb-b391-24fb0bd7f622 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1401efb776ab424e8ff4f09eac33d92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fca015df86428b9356df3f127327c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:14.024600 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-280dcebd-5c03-40bb-b391-24fb0bd7f622 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 200 len: 1326 microversion: 2.1 time: 0.123013 Jul 26 12:58:14.028747 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 430/851] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:13 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 1326 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:14.057336 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-46ad2bb9-6b7d-43fb-9535-1f8bb31bdda7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:14.064868 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-46ad2bb9-6b7d-43fb-9535-1f8bb31bdda7 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1510 microversion: 2.1 time: 0.158617 Jul 26 12:58:14.065624 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 422/852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:13 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:14.085548 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-80b66425-c697-4dc1-8644-94ade1135ee4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:14.086115 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-80b66425-c697-4dc1-8644-94ade1135ee4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:14.092150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-80b66425-c697-4dc1-8644-94ade1135ee4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:14.092614 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-80b66425-c697-4dc1-8644-94ade1135ee4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:14.093362 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-80b66425-c697-4dc1-8644-94ade1135ee4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:14.093797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-80b66425-c697-4dc1-8644-94ade1135ee4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:14.160634 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-37a457bb-b275-4ef1-aa08-dae577d83f98 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:14.161172 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-37a457bb-b275-4ef1-aa08-dae577d83f98 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:14.185891 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-80b66425-c697-4dc1-8644-94ade1135ee4 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "POST /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597/action" status: 202 len: 0 microversion: 2.1 time: 0.104178 Jul 26 12:58:14.190912 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 431/853] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 12:58:14 2022] POST /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:58:14.195372 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-37a457bb-b275-4ef1-aa08-dae577d83f98 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:14.195861 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-37a457bb-b275-4ef1-aa08-dae577d83f98 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:14.196650 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-37a457bb-b275-4ef1-aa08-dae577d83f98 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:14.197085 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-37a457bb-b275-4ef1-aa08-dae577d83f98 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:14.199778 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d69f7f10-d3f3-42bd-97a1-cbf6a332e1b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:14.203964 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d69f7f10-d3f3-42bd-97a1-cbf6a332e1b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:14.210508 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d69f7f10-d3f3-42bd-97a1-cbf6a332e1b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:14.210964 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d69f7f10-d3f3-42bd-97a1-cbf6a332e1b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:14.212009 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d69f7f10-d3f3-42bd-97a1-cbf6a332e1b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:14.212698 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d69f7f10-d3f3-42bd-97a1-cbf6a332e1b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:14.383797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d69f7f10-d3f3-42bd-97a1-cbf6a332e1b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:14.393527 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d69f7f10-d3f3-42bd-97a1-cbf6a332e1b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1518 microversion: 2.1 time: 0.198937 Jul 26 12:58:14.394118 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 432/854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:14 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:14.443879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-37a457bb-b275-4ef1-aa08-dae577d83f98 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:14.452299 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-37a457bb-b275-4ef1-aa08-dae577d83f98 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1453 microversion: 2.1 time: 0.301466 Jul 26 12:58:14.452872 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 423/855] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:14 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1453 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:58:14.472619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-add23532-97ca-408b-b2f3-ed897a263f0f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:14.473886 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-add23532-97ca-408b-b2f3-ed897a263f0f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:14.480171 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-cfd3b470-fbd8-4bf6-bfe3-4d6e3beb6576 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:14.481036 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-cfd3b470-fbd8-4bf6-bfe3-4d6e3beb6576 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:14.481281 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-add23532-97ca-408b-b2f3-ed897a263f0f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:14.481806 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-add23532-97ca-408b-b2f3-ed897a263f0f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:14.482795 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-add23532-97ca-408b-b2f3-ed897a263f0f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:14.483554 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-add23532-97ca-408b-b2f3-ed897a263f0f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:14.487332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cfd3b470-fbd8-4bf6-bfe3-4d6e3beb6576 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:14.487826 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cfd3b470-fbd8-4bf6-bfe3-4d6e3beb6576 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:14.488603 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cfd3b470-fbd8-4bf6-bfe3-4d6e3beb6576 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:14.489246 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-cfd3b470-fbd8-4bf6-bfe3-4d6e3beb6576 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:14.682736 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-add23532-97ca-408b-b2f3-ed897a263f0f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:14.686155 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-cfd3b470-fbd8-4bf6-bfe3-4d6e3beb6576 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:14.703788 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-cfd3b470-fbd8-4bf6-bfe3-4d6e3beb6576 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.221721 Jul 26 12:58:14.707412 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-add23532-97ca-408b-b2f3-ed897a263f0f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1453 microversion: 2.1 time: 0.238439 Jul 26 12:58:14.708351 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 433/856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:14 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1453 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:14.708775 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 424/857] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:14 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:58:15.046541 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-965f4f50-d32b-4901-b72f-9c36ba17dfdd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:15.047159 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-965f4f50-d32b-4901-b72f-9c36ba17dfdd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:15.055590 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-965f4f50-d32b-4901-b72f-9c36ba17dfdd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:15.056087 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-965f4f50-d32b-4901-b72f-9c36ba17dfdd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:15.057157 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-965f4f50-d32b-4901-b72f-9c36ba17dfdd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:15.057810 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-965f4f50-d32b-4901-b72f-9c36ba17dfdd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:15.072832 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-965f4f50-d32b-4901-b72f-9c36ba17dfdd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-965f4f50-d32b-4901-b72f-9c36ba17dfdd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 HTTP/1.1 Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:58:15.074516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:58:15.075987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:58:15.075987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:15.075987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:15.075987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:15.075987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:15.075987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:58:15.075987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:58:15.075987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:58:15.075987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:15.075987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:58:15.075987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:15.075987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '6b9e8067-dd21-438b-997e-100b012cd6f0'} Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:15.076801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:15.078567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:15.080083 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-965f4f50-d32b-4901-b72f-9c36ba17dfdd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 404 to user: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:15.080083 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-965f4f50-d32b-4901-b72f-9c36ba17dfdd tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 404 len: 111 microversion: 2.1 time: 0.033304 Jul 26 12:58:15.080083 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 434/858] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:15 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:58:15.085838 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a6defc2e-90d4-4560-aa02-43955e19e0c7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '.version_select at 0x7f65f9b99700>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:15.107304 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a6defc2e-90d4-4560-aa02-43955e19e0c7 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065845172" status: 202 len: 0 microversion: 2.1 time: 0.025799 Jul 26 12:58:15.108202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 425/859] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Jul 26 12:58:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065845172 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:58:15.415223 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5792879b-90de-4829-97a5-469bbda809f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:15.416859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5792879b-90de-4829-97a5-469bbda809f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:15.424719 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5792879b-90de-4829-97a5-469bbda809f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:15.425253 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5792879b-90de-4829-97a5-469bbda809f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:15.426115 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5792879b-90de-4829-97a5-469bbda809f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:15.426776 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5792879b-90de-4829-97a5-469bbda809f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:15.647281 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-54c06efa-4368-46de-876e-5ef8ad6dd2c0 req-27fb6bb5-69d3-4114-b61f-2a9befec79b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1331709-485e-470a-9dcb-0b8832524597", "name": "network-vif-unplugged", "status": "completed", "tag": "b9c4967a-1f5b-4bc9-9c07-7d4a8cc5768f"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:15.660672 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-54c06efa-4368-46de-876e-5ef8ad6dd2c0 req-27fb6bb5-69d3-4114-b61f-2a9befec79b4 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:15.661205 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-54c06efa-4368-46de-876e-5ef8ad6dd2c0 req-27fb6bb5-69d3-4114-b61f-2a9befec79b4 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:15.674684 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.compute.server_external_events [req-54c06efa-4368-46de-876e-5ef8ad6dd2c0 req-27fb6bb5-69d3-4114-b61f-2a9befec79b4 service nova] Unable to find a host for instance f1331709-485e-470a-9dcb-0b8832524597. Dropping event network-vif-unplugged {{(pid=129308) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 12:58:15.675960 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-54c06efa-4368-46de-876e-5ef8ad6dd2c0 req-27fb6bb5-69d3-4114-b61f-2a9befec79b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032471 Jul 26 12:58:15.676693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 426/860] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 26 12:58:15.701728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5792879b-90de-4829-97a5-469bbda809f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:15.710639 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5792879b-90de-4829-97a5-469bbda809f0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1520 microversion: 2.1 time: 0.299425 Jul 26 12:58:15.718897 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 435/861] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:15 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:15.738781 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-63aba020-f935-478d-b6ec-ad3bf8769dda tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:15.740919 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-63aba020-f935-478d-b6ec-ad3bf8769dda tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:15.749713 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-63aba020-f935-478d-b6ec-ad3bf8769dda tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:15.750661 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-63aba020-f935-478d-b6ec-ad3bf8769dda tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:15.751952 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-63aba020-f935-478d-b6ec-ad3bf8769dda tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:15.752677 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-63aba020-f935-478d-b6ec-ad3bf8769dda tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:15.978171 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-63aba020-f935-478d-b6ec-ad3bf8769dda tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:15.988448 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-63aba020-f935-478d-b6ec-ad3bf8769dda tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.253829 Jul 26 12:58:15.989281 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 427/862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:15 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:16.656600 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-20da6988-672c-4f30-9be9-29faf17e5968 req-b9502132-f53c-406b-8d12-05fcdd90f80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d1d6a8-9517-49ed-b0eb-d90086cd1783", "tag": "5d30f17c-376a-40af-aea4-819f4cd01ebc"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:16.666768 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-20da6988-672c-4f30-9be9-29faf17e5968 req-b9502132-f53c-406b-8d12-05fcdd90f80a service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:16.667510 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-20da6988-672c-4f30-9be9-29faf17e5968 req-b9502132-f53c-406b-8d12-05fcdd90f80a service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:16.680245 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-20da6988-672c-4f30-9be9-29faf17e5968 req-b9502132-f53c-406b-8d12-05fcdd90f80a service nova] Creating event network-changed:5d30f17c-376a-40af-aea4-819f4cd01ebc for instance 62d1d6a8-9517-49ed-b0eb-d90086cd1783 on hv-cinder-85093 Jul 26 12:58:16.685248 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-20da6988-672c-4f30-9be9-29faf17e5968 req-b9502132-f53c-406b-8d12-05fcdd90f80a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032779 Jul 26 12:58:16.685842 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 436/863] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:16.740410 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-47ad6415-a7ea-4f08-98a2-304479062c67 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:16.741024 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-47ad6415-a7ea-4f08-98a2-304479062c67 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:16.747929 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-47ad6415-a7ea-4f08-98a2-304479062c67 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:16.748383 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-47ad6415-a7ea-4f08-98a2-304479062c67 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:16.749154 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-47ad6415-a7ea-4f08-98a2-304479062c67 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:16.749601 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-47ad6415-a7ea-4f08-98a2-304479062c67 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:16.891871 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-47ad6415-a7ea-4f08-98a2-304479062c67 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:16.899968 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-47ad6415-a7ea-4f08-98a2-304479062c67 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1576 microversion: 2.1 time: 0.163302 Jul 26 12:58:16.900541 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 428/864] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:16 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:17.013322 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3b6d5966-f6d0-4871-a285-ac0b6c518f67 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:17.014117 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3b6d5966-f6d0-4871-a285-ac0b6c518f67 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:17.020797 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3b6d5966-f6d0-4871-a285-ac0b6c518f67 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:17.021326 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3b6d5966-f6d0-4871-a285-ac0b6c518f67 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:17.022192 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3b6d5966-f6d0-4871-a285-ac0b6c518f67 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:17.022721 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3b6d5966-f6d0-4871-a285-ac0b6c518f67 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:17.106997 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-63971199-9f64-482e-84e6-404ae525978c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:17.108137 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-63971199-9f64-482e-84e6-404ae525978c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:17.115091 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-63971199-9f64-482e-84e6-404ae525978c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:17.115545 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-63971199-9f64-482e-84e6-404ae525978c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:17.121693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-63971199-9f64-482e-84e6-404ae525978c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:17.122434 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-63971199-9f64-482e-84e6-404ae525978c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:17.139296 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-63971199-9f64-482e-84e6-404ae525978c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-63971199-9f64-482e-84e6-404ae525978c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: DELETE /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 HTTP/1.1 Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:58:17.141528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:58:17.143018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:58:17.143018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:17.143018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:17.143018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:17.143018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:17.143018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:58:17.143018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:58:17.143018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:58:17.143018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:17.143018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:58:17.143018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:17.143018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '6b9e8067-dd21-438b-997e-100b012cd6f0'} Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:17.143793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:17.146729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:17.151862 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-63971199-9f64-482e-84e6-404ae525978c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 404 to user: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:17.153602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-63971199-9f64-482e-84e6-404ae525978c tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 404 len: 111 microversion: 2.1 time: 0.050379 Jul 26 12:58:17.154192 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 429/865] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:58:17 2022] DELETE /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 12:58:17.166735 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-dea093bf-e59e-4535-b9e1-e65aeb8e7f68 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:17.167718 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-dea093bf-e59e-4535-b9e1-e65aeb8e7f68 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 6b9e8067-dd21-438b-997e-100b012cd6f0] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:17.176132 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dea093bf-e59e-4535-b9e1-e65aeb8e7f68 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:17.177109 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dea093bf-e59e-4535-b9e1-e65aeb8e7f68 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:17.178135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dea093bf-e59e-4535-b9e1-e65aeb8e7f68 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:17.178396 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3b6d5966-f6d0-4871-a285-ac0b6c518f67 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:17.179607 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dea093bf-e59e-4535-b9e1-e65aeb8e7f68 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:17.187610 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3b6d5966-f6d0-4871-a285-ac0b6c518f67 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.178443 Jul 26 12:58:17.188219 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 437/866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:17 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:17.197457 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-dea093bf-e59e-4535-b9e1-e65aeb8e7f68 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-dea093bf-e59e-4535-b9e1-e65aeb8e7f68 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 HTTP/1.1 Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:58:17.199004 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:58:17.200532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:58:17.200532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:17.200532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:17.200532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:17.200532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:17.200532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:58:17.200532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:58:17.200532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:58:17.200532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:17.200532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:58:17.200532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:17.200532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '6b9e8067-dd21-438b-997e-100b012cd6f0'} Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:17.204250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. Jul 26 12:58:17.205972 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:17.207748 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-dea093bf-e59e-4535-b9e1-e65aeb8e7f68 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 404 to user: Instance 6b9e8067-dd21-438b-997e-100b012cd6f0 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:17.207748 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-dea093bf-e59e-4535-b9e1-e65aeb8e7f68 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0" status: 404 len: 111 microversion: 2.1 time: 0.038091 Jul 26 12:58:17.207748 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 430/867] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:17 2022] GET /compute/v2.1/servers/6b9e8067-dd21-438b-997e-100b012cd6f0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:58:17.921249 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-0927f672-8caa-48d7-846e-8cefb5812528 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:17.921774 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-0927f672-8caa-48d7-846e-8cefb5812528 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:17.928326 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0927f672-8caa-48d7-846e-8cefb5812528 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:17.928781 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0927f672-8caa-48d7-846e-8cefb5812528 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:17.929551 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0927f672-8caa-48d7-846e-8cefb5812528 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:17.929989 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0927f672-8caa-48d7-846e-8cefb5812528 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:18.063153 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-0927f672-8caa-48d7-846e-8cefb5812528 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:18.066719 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:18.072481 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-0927f672-8caa-48d7-846e-8cefb5812528 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1576 microversion: 2.1 time: 0.155195 Jul 26 12:58:18.073052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 438/868] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:17 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:18.208942 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d82ef0b4-9c8a-463b-b7cb-c0956369984e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:18.209549 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d82ef0b4-9c8a-463b-b7cb-c0956369984e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:18.216069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d82ef0b4-9c8a-463b-b7cb-c0956369984e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:18.216517 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d82ef0b4-9c8a-463b-b7cb-c0956369984e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:18.217276 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d82ef0b4-9c8a-463b-b7cb-c0956369984e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:18.217708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d82ef0b4-9c8a-463b-b7cb-c0956369984e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:18.349105 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d82ef0b4-9c8a-463b-b7cb-c0956369984e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:18.351700 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e08aacfa-860f-4828-9b0e-1615937b977b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:18.352199 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e08aacfa-860f-4828-9b0e-1615937b977b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:18.359154 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e08aacfa-860f-4828-9b0e-1615937b977b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:18.359598 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e08aacfa-860f-4828-9b0e-1615937b977b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:18.359747 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d82ef0b4-9c8a-463b-b7cb-c0956369984e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.154403 Jul 26 12:58:18.360471 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 431/869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:18 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:18.367160 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e08aacfa-860f-4828-9b0e-1615937b977b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:18.367941 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e08aacfa-860f-4828-9b0e-1615937b977b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:18.384601 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-e08aacfa-860f-4828-9b0e-1615937b977b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e08aacfa-860f-4828-9b0e-1615937b977b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: DELETE /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c HTTP/1.1 Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:58:18.386400 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:58:18.387927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:58:18.387927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:18.387927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:18.387927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:18.387927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:18.387927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:58:18.387927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:58:18.387927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:58:18.387927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:18.387927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:58:18.387927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:58:18.387927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '35776963-2d4e-4698-9ad3-b91a5be95f1c'} Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:18.388773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:58:18.390150 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.391561 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e08aacfa-860f-4828-9b0e-1615937b977b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 404 to user: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:18.391561 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e08aacfa-860f-4828-9b0e-1615937b977b tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 404 len: 111 microversion: 2.1 time: 0.040601 Jul 26 12:58:18.391561 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 439/870] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:58:18 2022] DELETE /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 12:58:18.396752 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d0ed7f6d-f65f-4184-9c5f-75e3d3ec0a10 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:18.397406 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d0ed7f6d-f65f-4184-9c5f-75e3d3ec0a10 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 35776963-2d4e-4698-9ad3-b91a5be95f1c] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:18.403736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d0ed7f6d-f65f-4184-9c5f-75e3d3ec0a10 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:18.404189 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d0ed7f6d-f65f-4184-9c5f-75e3d3ec0a10 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:18.404958 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d0ed7f6d-f65f-4184-9c5f-75e3d3ec0a10 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:18.405395 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d0ed7f6d-f65f-4184-9c5f-75e3d3ec0a10 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:18.419225 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-d0ed7f6d-f65f-4184-9c5f-75e3d3ec0a10 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d0ed7f6d-f65f-4184-9c5f-75e3d3ec0a10 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c HTTP/1.1 Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:58:18.420778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:58:18.422370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:58:18.422370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:18.422370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:18.422370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:18.422370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:18.422370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:58:18.422370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:58:18.422370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:58:18.422370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:18.422370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:58:18.422370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:58:18.422370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '35776963-2d4e-4698-9ad3-b91a5be95f1c'} Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:18.423254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. Jul 26 12:58:18.424731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.425996 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d0ed7f6d-f65f-4184-9c5f-75e3d3ec0a10 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 404 to user: Instance 35776963-2d4e-4698-9ad3-b91a5be95f1c could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:18.425996 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d0ed7f6d-f65f-4184-9c5f-75e3d3ec0a10 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c" status: 404 len: 111 microversion: 2.1 time: 0.029402 Jul 26 12:58:18.426163 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 432/871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:18 2022] GET /compute/v2.1/servers/35776963-2d4e-4698-9ad3-b91a5be95f1c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:58:18.431623 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-54da6e8f-9847-4476-b595-70ee2c2e7962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:18.432203 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-54da6e8f-9847-4476-b595-70ee2c2e7962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:18.438551 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-54da6e8f-9847-4476-b595-70ee2c2e7962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:18.439176 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-54da6e8f-9847-4476-b595-70ee2c2e7962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:18.440066 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-54da6e8f-9847-4476-b595-70ee2c2e7962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:18.440572 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-54da6e8f-9847-4476-b595-70ee2c2e7962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:18.454954 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-54da6e8f-9847-4476-b595-70ee2c2e7962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-54da6e8f-9847-4476-b595-70ee2c2e7962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: DELETE /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b HTTP/1.1 Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:58:18.456536 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:58:18.458011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:58:18.458011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:18.458011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:18.458011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:18.458011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:18.458011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:58:18.458011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:58:18.458011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:58:18.458011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:18.458011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:58:18.458011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:58:18.458011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': 'fa1010ce-5874-41a9-900d-cb5355c11d1b'} Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:18.458748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:58:18.460052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.461317 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-54da6e8f-9847-4476-b595-70ee2c2e7962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 404 to user: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:18.461317 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-54da6e8f-9847-4476-b595-70ee2c2e7962 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 404 len: 111 microversion: 2.1 time: 0.030996 Jul 26 12:58:18.461317 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 440/872] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:58:18 2022] DELETE /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 12:58:18.466864 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-305d0e6c-9c82-4afc-94ec-088bcc6b6472 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:18.467475 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-305d0e6c-9c82-4afc-94ec-088bcc6b6472 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: fa1010ce-5874-41a9-900d-cb5355c11d1b] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:18.473515 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-305d0e6c-9c82-4afc-94ec-088bcc6b6472 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:18.473959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-305d0e6c-9c82-4afc-94ec-088bcc6b6472 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:18.474718 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-305d0e6c-9c82-4afc-94ec-088bcc6b6472 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:18.475160 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-305d0e6c-9c82-4afc-94ec-088bcc6b6472 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:18.488934 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-305d0e6c-9c82-4afc-94ec-088bcc6b6472 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-305d0e6c-9c82-4afc-94ec-088bcc6b6472 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b HTTP/1.1 Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:58:18.490435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:58:18.492571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:58:18.492571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:18.492571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:18.492571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:18.492571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:18.492571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:58:18.492571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:58:18.492571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:58:18.492571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:18.492571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:58:18.492571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:58:18.492571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': 'fa1010ce-5874-41a9-900d-cb5355c11d1b'} Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:18.496332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. Jul 26 12:58:18.497736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:18.499029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-305d0e6c-9c82-4afc-94ec-088bcc6b6472 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 404 to user: Instance fa1010ce-5874-41a9-900d-cb5355c11d1b could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:18.499029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-305d0e6c-9c82-4afc-94ec-088bcc6b6472 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b" status: 404 len: 111 microversion: 2.1 time: 0.029256 Jul 26 12:58:18.499029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 433/873] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:18 2022] GET /compute/v2.1/servers/fa1010ce-5874-41a9-900d-cb5355c11d1b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:58:19.094457 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b5055289-cfed-4912-ade1-091ee0a9d3cc tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:19.094976 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b5055289-cfed-4912-ade1-091ee0a9d3cc tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:19.102293 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b5055289-cfed-4912-ade1-091ee0a9d3cc tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:19.102751 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b5055289-cfed-4912-ade1-091ee0a9d3cc tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:19.103520 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b5055289-cfed-4912-ade1-091ee0a9d3cc tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:19.103992 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b5055289-cfed-4912-ade1-091ee0a9d3cc tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:19.239913 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b5055289-cfed-4912-ade1-091ee0a9d3cc tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:19.247329 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b5055289-cfed-4912-ade1-091ee0a9d3cc tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1576 microversion: 2.1 time: 0.156878 Jul 26 12:58:19.247925 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 441/874] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:19 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:19.381616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-431abc84-9db8-4497-a925-088a970edc22 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:19.382650 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-431abc84-9db8-4497-a925-088a970edc22 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:19.389677 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-431abc84-9db8-4497-a925-088a970edc22 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:19.390131 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-431abc84-9db8-4497-a925-088a970edc22 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:19.390961 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-431abc84-9db8-4497-a925-088a970edc22 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:19.391343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-431abc84-9db8-4497-a925-088a970edc22 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:19.395467 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:19.541637 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-431abc84-9db8-4497-a925-088a970edc22 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:19.549722 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-431abc84-9db8-4497-a925-088a970edc22 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.172304 Jul 26 12:58:19.550287 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 434/875] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:19 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:19.638299 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-51fa71b3-238e-4d48-af00-e9f4632a5dc0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:19.638653 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-51fa71b3-238e-4d48-af00-e9f4632a5dc0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:19.645019 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-51fa71b3-238e-4d48-af00-e9f4632a5dc0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:19.645477 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-51fa71b3-238e-4d48-af00-e9f4632a5dc0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:19.646245 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-51fa71b3-238e-4d48-af00-e9f4632a5dc0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:19.646681 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-51fa71b3-238e-4d48-af00-e9f4632a5dc0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:19.660448 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-51fa71b3-238e-4d48-af00-e9f4632a5dc0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-51fa71b3-238e-4d48-af00-e9f4632a5dc0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: DELETE /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 HTTP/1.1 Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:58:19.662018 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:58:19.663599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:58:19.663599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:19.663599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:19.663599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:19.663599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:19.663599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:58:19.663599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:58:19.663599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:58:19.663599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:19.663599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:58:19.663599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:58:19.663599 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4'} Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:19.664504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:58:19.666055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:19.667410 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-51fa71b3-238e-4d48-af00-e9f4632a5dc0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 404 to user: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:19.667410 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-51fa71b3-238e-4d48-af00-e9f4632a5dc0 tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 404 len: 111 microversion: 2.1 time: 0.029095 Jul 26 12:58:19.667410 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 442/876] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:58:19 2022] DELETE /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:58:19.672382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6a41a421-595b-4ab9-9628-5daa20003ecf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:19.673104 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6a41a421-595b-4ab9-9628-5daa20003ecf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] [instance: 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:19.679785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6a41a421-595b-4ab9-9628-5daa20003ecf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:19.680243 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6a41a421-595b-4ab9-9628-5daa20003ecf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:19.681005 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6a41a421-595b-4ab9-9628-5daa20003ecf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:19.681444 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6a41a421-595b-4ab9-9628-5daa20003ecf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:19.695059 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-6a41a421-595b-4ab9-9628-5daa20003ecf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] HTTP exception thrown: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6a41a421-595b-4ab9-9628-5daa20003ecf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Request method failure captured: Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 HTTP/1.1 Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-NPyAr6jSqzd9FiHw6cJ_6s2MjQeNPr75s9OMbTehMGgzDyQCTS9GOSYwpplhwQxAVfVCoWdLNvl_XtlWuJ0ReDMtiyHk4mjTHZ_g-w--0jCkJ5Oi93t4IxJLfnAf22Lsx8437hZjzKrI3NWIE1cX5bkmrkYOalKyZIflPLatlVJrU Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:58:19.696595 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:58:19.698135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01fca015df86428b9356df3f127327c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01fca015df86428b9356df3f127327c2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01fca015df86428b9356df3f127327c2"}]}] Jul 26 12:58:19.698135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:19.698135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: 01fca015df86428b9356df3f127327c2 Jul 26 12:58:19.698135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1778056198 Jul 26 12:58:19.698135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:19.698135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:58:19.698135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:58:19.698135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 1401efb776ab424e8ff4f09eac33d92f Jul 26 12:58:19.698135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-AttachVolumeNegativeTest-1778056198-project Jul 26 12:58:19.698135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:58:19.698135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:58:19.698135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4'} Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:19.699174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. Jul 26 12:58:19.700679 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:19.702098 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6a41a421-595b-4ab9-9628-5daa20003ecf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] Returning 404 to user: Instance 7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:19.702098 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6a41a421-595b-4ab9-9628-5daa20003ecf tempest-AttachVolumeNegativeTest-1778056198 tempest-AttachVolumeNegativeTest-1778056198-project] 10.222.0.20 "GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4" status: 404 len: 111 microversion: 2.1 time: 0.029472 Jul 26 12:58:19.702098 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 435/877] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:19 2022] GET /compute/v2.1/servers/7a5a3a8f-59d5-4879-9de0-bbe046dbf3f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:58:20.268695 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b2f7843f-f0c7-44b3-8460-0bed71066a4b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:20.269309 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b2f7843f-f0c7-44b3-8460-0bed71066a4b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:20.276194 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b2f7843f-f0c7-44b3-8460-0bed71066a4b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:20.277003 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b2f7843f-f0c7-44b3-8460-0bed71066a4b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:20.277829 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b2f7843f-f0c7-44b3-8460-0bed71066a4b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:20.278273 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b2f7843f-f0c7-44b3-8460-0bed71066a4b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:20.421707 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b2f7843f-f0c7-44b3-8460-0bed71066a4b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:20.429350 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b2f7843f-f0c7-44b3-8460-0bed71066a4b tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1576 microversion: 2.1 time: 0.164548 Jul 26 12:58:20.429908 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 443/878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:20 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:20.571465 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-791c12fd-49b9-4d92-9f25-81fdbeb31199 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:20.572244 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-791c12fd-49b9-4d92-9f25-81fdbeb31199 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:20.578516 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-791c12fd-49b9-4d92-9f25-81fdbeb31199 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:20.578969 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-791c12fd-49b9-4d92-9f25-81fdbeb31199 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:20.579770 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-791c12fd-49b9-4d92-9f25-81fdbeb31199 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:20.580215 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-791c12fd-49b9-4d92-9f25-81fdbeb31199 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:20.833389 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-791c12fd-49b9-4d92-9f25-81fdbeb31199 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:20.844138 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-791c12fd-49b9-4d92-9f25-81fdbeb31199 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.276495 Jul 26 12:58:20.845003 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 436/879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:20 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:21.450272 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-44c7b6d4-3d92-4613-b319-b1e4de93fdfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:21.451004 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-44c7b6d4-3d92-4613-b319-b1e4de93fdfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:21.457945 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-44c7b6d4-3d92-4613-b319-b1e4de93fdfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:21.458404 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-44c7b6d4-3d92-4613-b319-b1e4de93fdfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:21.459181 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-44c7b6d4-3d92-4613-b319-b1e4de93fdfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:21.459623 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-44c7b6d4-3d92-4613-b319-b1e4de93fdfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:21.603893 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-44c7b6d4-3d92-4613-b319-b1e4de93fdfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:21.611919 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-44c7b6d4-3d92-4613-b319-b1e4de93fdfd tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1576 microversion: 2.1 time: 0.165490 Jul 26 12:58:21.612513 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 444/880] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:21 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:21.869449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b09ccc44-2693-4050-93f6-a09419fab31a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:21.870793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b09ccc44-2693-4050-93f6-a09419fab31a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:21.879215 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b09ccc44-2693-4050-93f6-a09419fab31a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:21.880013 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b09ccc44-2693-4050-93f6-a09419fab31a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:21.881292 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b09ccc44-2693-4050-93f6-a09419fab31a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:21.882415 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b09ccc44-2693-4050-93f6-a09419fab31a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:22.030142 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-b09ccc44-2693-4050-93f6-a09419fab31a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:22.039114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b09ccc44-2693-4050-93f6-a09419fab31a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.174695 Jul 26 12:58:22.039729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 437/881] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:21 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:22.632986 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-29700f10-45c6-4ad9-a550-2c101769ef96 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:22.633600 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-29700f10-45c6-4ad9-a550-2c101769ef96 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:22.640235 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-29700f10-45c6-4ad9-a550-2c101769ef96 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:22.640684 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-29700f10-45c6-4ad9-a550-2c101769ef96 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:22.641445 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-29700f10-45c6-4ad9-a550-2c101769ef96 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:22.641880 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-29700f10-45c6-4ad9-a550-2c101769ef96 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:22.852414 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-29700f10-45c6-4ad9-a550-2c101769ef96 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:22.860900 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-29700f10-45c6-4ad9-a550-2c101769ef96 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1576 microversion: 2.1 time: 0.232124 Jul 26 12:58:22.862008 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 445/882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:22 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:23.061322 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-eb694cef-7ad1-4bf2-b719-81a307e392c2 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:23.061955 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-eb694cef-7ad1-4bf2-b719-81a307e392c2 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:23.068945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-eb694cef-7ad1-4bf2-b719-81a307e392c2 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:23.070417 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-eb694cef-7ad1-4bf2-b719-81a307e392c2 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:23.071876 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-eb694cef-7ad1-4bf2-b719-81a307e392c2 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:23.072824 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-eb694cef-7ad1-4bf2-b719-81a307e392c2 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:23.261268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-eb694cef-7ad1-4bf2-b719-81a307e392c2 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:23.282938 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-eb694cef-7ad1-4bf2-b719-81a307e392c2 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.225637 Jul 26 12:58:23.283521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 438/883] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:23 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:23.883723 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-70a97d2e-1958-45f6-9eb8-9187580f5d4e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:23.892064 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-70a97d2e-1958-45f6-9eb8-9187580f5d4e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:23.908153 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-70a97d2e-1958-45f6-9eb8-9187580f5d4e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:23.909211 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-70a97d2e-1958-45f6-9eb8-9187580f5d4e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:23.910183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-70a97d2e-1958-45f6-9eb8-9187580f5d4e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:23.910781 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-70a97d2e-1958-45f6-9eb8-9187580f5d4e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:24.108280 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-70a97d2e-1958-45f6-9eb8-9187580f5d4e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:24.115796 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-70a97d2e-1958-45f6-9eb8-9187580f5d4e tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1576 microversion: 2.1 time: 0.237257 Jul 26 12:58:24.117026 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 446/884] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:23 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:24.304451 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-66ec2016-8494-469b-a224-aff9b5f92f8d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:24.305767 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-66ec2016-8494-469b-a224-aff9b5f92f8d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:24.312769 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-66ec2016-8494-469b-a224-aff9b5f92f8d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:24.313347 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-66ec2016-8494-469b-a224-aff9b5f92f8d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:24.314809 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-66ec2016-8494-469b-a224-aff9b5f92f8d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:24.315466 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-66ec2016-8494-469b-a224-aff9b5f92f8d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:24.471351 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-66ec2016-8494-469b-a224-aff9b5f92f8d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:24.480086 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-66ec2016-8494-469b-a224-aff9b5f92f8d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.179457 Jul 26 12:58:24.480652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 439/885] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:24 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:25.138098 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b0e1060d-19f9-4a08-9d41-fd340cb4b4a2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:25.138721 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b0e1060d-19f9-4a08-9d41-fd340cb4b4a2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:25.145554 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b0e1060d-19f9-4a08-9d41-fd340cb4b4a2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:25.146083 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b0e1060d-19f9-4a08-9d41-fd340cb4b4a2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:25.146923 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b0e1060d-19f9-4a08-9d41-fd340cb4b4a2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:25.147456 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b0e1060d-19f9-4a08-9d41-fd340cb4b4a2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:25.288915 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b0e1060d-19f9-4a08-9d41-fd340cb4b4a2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:25.296944 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b0e1060d-19f9-4a08-9d41-fd340cb4b4a2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1576 microversion: 2.1 time: 0.162862 Jul 26 12:58:25.297560 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 447/886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:25 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:25.501739 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3bfc10ea-f882-434e-970e-fd4162e2e2ac tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:25.502383 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3bfc10ea-f882-434e-970e-fd4162e2e2ac tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:25.509602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3bfc10ea-f882-434e-970e-fd4162e2e2ac tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:25.510086 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3bfc10ea-f882-434e-970e-fd4162e2e2ac tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:25.510867 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3bfc10ea-f882-434e-970e-fd4162e2e2ac tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:25.511305 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3bfc10ea-f882-434e-970e-fd4162e2e2ac tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:25.669931 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3bfc10ea-f882-434e-970e-fd4162e2e2ac tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:25.680072 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3bfc10ea-f882-434e-970e-fd4162e2e2ac tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.182131 Jul 26 12:58:25.681082 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 440/887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:25 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:25.737222 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-f561e766-97c2-4b6f-8c5d-65db8bcde32b req-3e61b979-919c-4ba4-bb89-c4e5dcbdb1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1331709-485e-470a-9dcb-0b8832524597", "name": "network-vif-plugged", "status": "completed", "tag": "b9c4967a-1f5b-4bc9-9c07-7d4a8cc5768f"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:25.749379 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-f561e766-97c2-4b6f-8c5d-65db8bcde32b req-3e61b979-919c-4ba4-bb89-c4e5dcbdb1b8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:25.749827 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-f561e766-97c2-4b6f-8c5d-65db8bcde32b req-3e61b979-919c-4ba4-bb89-c4e5dcbdb1b8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:25.762699 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-f561e766-97c2-4b6f-8c5d-65db8bcde32b req-3e61b979-919c-4ba4-bb89-c4e5dcbdb1b8 service nova] Creating event network-vif-plugged:b9c4967a-1f5b-4bc9-9c07-7d4a8cc5768f for instance f1331709-485e-470a-9dcb-0b8832524597 on hv-cinder-85093 Jul 26 12:58:25.767923 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-f561e766-97c2-4b6f-8c5d-65db8bcde32b req-3e61b979-919c-4ba4-bb89-c4e5dcbdb1b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035386 Jul 26 12:58:25.768729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 448/888] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:26.318669 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d306cb0d-4c53-4dc4-93a2-23e94a8476e5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:26.319790 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d306cb0d-4c53-4dc4-93a2-23e94a8476e5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:26.325790 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d306cb0d-4c53-4dc4-93a2-23e94a8476e5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:26.326240 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d306cb0d-4c53-4dc4-93a2-23e94a8476e5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:26.327007 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d306cb0d-4c53-4dc4-93a2-23e94a8476e5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:26.327441 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d306cb0d-4c53-4dc4-93a2-23e94a8476e5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:26.460641 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d306cb0d-4c53-4dc4-93a2-23e94a8476e5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:26.468048 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d306cb0d-4c53-4dc4-93a2-23e94a8476e5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1576 microversion: 2.1 time: 0.153408 Jul 26 12:58:26.468598 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 441/889] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:26 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:26.703826 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c40ef5e4-26bf-4060-8d1a-5f0e74d7b7d0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:26.704441 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c40ef5e4-26bf-4060-8d1a-5f0e74d7b7d0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:26.711069 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c40ef5e4-26bf-4060-8d1a-5f0e74d7b7d0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:26.711516 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c40ef5e4-26bf-4060-8d1a-5f0e74d7b7d0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:26.712300 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c40ef5e4-26bf-4060-8d1a-5f0e74d7b7d0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:26.712736 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c40ef5e4-26bf-4060-8d1a-5f0e74d7b7d0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:26.843228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c40ef5e4-26bf-4060-8d1a-5f0e74d7b7d0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:26.851751 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c40ef5e4-26bf-4060-8d1a-5f0e74d7b7d0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.152208 Jul 26 12:58:26.852320 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 449/890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:26 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:27.488962 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7ae9949f-d960-47a0-9f0d-9efc9888a8e0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:27.489571 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7ae9949f-d960-47a0-9f0d-9efc9888a8e0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:27.496596 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ae9949f-d960-47a0-9f0d-9efc9888a8e0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:27.497045 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ae9949f-d960-47a0-9f0d-9efc9888a8e0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:27.497809 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ae9949f-d960-47a0-9f0d-9efc9888a8e0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:27.498251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ae9949f-d960-47a0-9f0d-9efc9888a8e0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:27.633750 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7ae9949f-d960-47a0-9f0d-9efc9888a8e0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:27.645476 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7ae9949f-d960-47a0-9f0d-9efc9888a8e0 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1576 microversion: 2.1 time: 0.160129 Jul 26 12:58:27.646313 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 442/891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:27 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:27.874194 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-43bf8af3-4bc4-422c-bd64-bbeeb143cf7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:27.874804 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-43bf8af3-4bc4-422c-bd64-bbeeb143cf7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:27.881632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-43bf8af3-4bc4-422c-bd64-bbeeb143cf7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:27.882078 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-43bf8af3-4bc4-422c-bd64-bbeeb143cf7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:27.882836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-43bf8af3-4bc4-422c-bd64-bbeeb143cf7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:27.883268 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-43bf8af3-4bc4-422c-bd64-bbeeb143cf7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:28.013318 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-43bf8af3-4bc4-422c-bd64-bbeeb143cf7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:28.021237 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-43bf8af3-4bc4-422c-bd64-bbeeb143cf7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1722 microversion: 2.1 time: 0.151115 Jul 26 12:58:28.021807 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 450/892] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:27 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:28.668497 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-72da5606-a888-42b2-ac51-97a9224a8bf2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:28.669056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-72da5606-a888-42b2-ac51-97a9224a8bf2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:28.678008 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-72da5606-a888-42b2-ac51-97a9224a8bf2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:28.679239 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-72da5606-a888-42b2-ac51-97a9224a8bf2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:28.680798 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-72da5606-a888-42b2-ac51-97a9224a8bf2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:28.681525 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-72da5606-a888-42b2-ac51-97a9224a8bf2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:28.818347 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-72da5606-a888-42b2-ac51-97a9224a8bf2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:28.826481 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-72da5606-a888-42b2-ac51-97a9224a8bf2 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1563 microversion: 2.1 time: 0.162009 Jul 26 12:58:28.827050 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 443/893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:28 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:29.045165 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d3d151d1-1063-470e-85aa-901920f17716 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:29.045781 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d3d151d1-1063-470e-85aa-901920f17716 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:29.052405 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d3d151d1-1063-470e-85aa-901920f17716 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:29.052859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d3d151d1-1063-470e-85aa-901920f17716 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:29.054306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d3d151d1-1063-470e-85aa-901920f17716 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:29.054752 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d3d151d1-1063-470e-85aa-901920f17716 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:29.186139 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d3d151d1-1063-470e-85aa-901920f17716 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:29.194134 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d3d151d1-1063-470e-85aa-901920f17716 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1699 microversion: 2.1 time: 0.152879 Jul 26 12:58:29.194700 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 451/894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:29 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:29.214188 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9a84f665-b1d4-4146-a2f6-9995b0cab92f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:29.220103 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9a84f665-b1d4-4146-a2f6-9995b0cab92f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:29.220545 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9a84f665-b1d4-4146-a2f6-9995b0cab92f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:29.286403 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-9a84f665-b1d4-4146-a2f6-9995b0cab92f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Going to try to start instance {{(pid=129308) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 12:58:29.327996 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9a84f665-b1d4-4146-a2f6-9995b0cab92f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "POST /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/action" status: 202 len: 0 microversion: 2.1 time: 0.117296 Jul 26 12:58:29.328544 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 444/895] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 12:58:29 2022] POST /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:58:29.336764 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ae02bb72-5c5c-4ca8-aefe-40ec01e645d4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:29.337372 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ae02bb72-5c5c-4ca8-aefe-40ec01e645d4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:29.343473 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ae02bb72-5c5c-4ca8-aefe-40ec01e645d4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:29.343815 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ae02bb72-5c5c-4ca8-aefe-40ec01e645d4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:29.344625 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ae02bb72-5c5c-4ca8-aefe-40ec01e645d4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:29.345100 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ae02bb72-5c5c-4ca8-aefe-40ec01e645d4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:29.480634 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ae02bb72-5c5c-4ca8-aefe-40ec01e645d4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:29.488656 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ae02bb72-5c5c-4ca8-aefe-40ec01e645d4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1708 microversion: 2.1 time: 0.155865 Jul 26 12:58:29.489233 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 452/896] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:29 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:30.511904 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-44d00307-38a0-4d2c-91b0-5bff787a03ba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:30.512600 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-44d00307-38a0-4d2c-91b0-5bff787a03ba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:30.519023 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-44d00307-38a0-4d2c-91b0-5bff787a03ba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:30.519477 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-44d00307-38a0-4d2c-91b0-5bff787a03ba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:30.520296 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-44d00307-38a0-4d2c-91b0-5bff787a03ba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:30.520762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-44d00307-38a0-4d2c-91b0-5bff787a03ba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:30.658609 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-44d00307-38a0-4d2c-91b0-5bff787a03ba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:30.667515 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-44d00307-38a0-4d2c-91b0-5bff787a03ba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1708 microversion: 2.1 time: 0.161037 Jul 26 12:58:30.668119 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 445/897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:30 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1708 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:31.690462 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-60f850a2-65f0-40f4-a2b1-a5d860cae253 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:31.691007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-60f850a2-65f0-40f4-a2b1-a5d860cae253 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:31.698362 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-60f850a2-65f0-40f4-a2b1-a5d860cae253 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:31.698815 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-60f850a2-65f0-40f4-a2b1-a5d860cae253 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:31.699593 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-60f850a2-65f0-40f4-a2b1-a5d860cae253 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:31.700088 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-60f850a2-65f0-40f4-a2b1-a5d860cae253 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:31.838597 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-60f850a2-65f0-40f4-a2b1-a5d860cae253 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:31.846449 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-60f850a2-65f0-40f4-a2b1-a5d860cae253 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1712 microversion: 2.1 time: 0.160028 Jul 26 12:58:31.847012 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 453/898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:31 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1712 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:34.695856 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-bf92c70c-5fce-401d-b8ba-6bb20e9efb79 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:34.698027 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-bf92c70c-5fce-401d-b8ba-6bb20e9efb79 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:34.705432 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bf92c70c-5fce-401d-b8ba-6bb20e9efb79 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:34.705879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bf92c70c-5fce-401d-b8ba-6bb20e9efb79 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:34.706653 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bf92c70c-5fce-401d-b8ba-6bb20e9efb79 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:34.707105 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bf92c70c-5fce-401d-b8ba-6bb20e9efb79 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:34.736974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-bf92c70c-5fce-401d-b8ba-6bb20e9efb79 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045066 Jul 26 12:58:34.737732 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 446/899] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Jul 26 12:58:34 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:34.799687 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b2c19a8d-f87e-410a-a338-bb7b753b072d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:34.800208 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b2c19a8d-f87e-410a-a338-bb7b753b072d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:34.802604 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=82 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:34.808235 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b2c19a8d-f87e-410a-a338-bb7b753b072d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:34.808684 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b2c19a8d-f87e-410a-a338-bb7b753b072d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:34.809445 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b2c19a8d-f87e-410a-a338-bb7b753b072d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:34.809878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b2c19a8d-f87e-410a-a338-bb7b753b072d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:34.834450 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b2c19a8d-f87e-410a-a338-bb7b753b072d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Going to try to terminate instance {{(pid=129307) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:58:34.916745 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b2c19a8d-f87e-410a-a338-bb7b753b072d tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "DELETE /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 204 len: 0 microversion: 2.20 time: 0.120408 Jul 26 12:58:34.917853 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 454/900] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Jul 26 12:58:34 2022] DELETE /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 12:58:34.925932 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c159b6ba-7fdf-4bca-ae9f-d26bc36a5362 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:34.926628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c159b6ba-7fdf-4bca-ae9f-d26bc36a5362 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:34.933464 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c159b6ba-7fdf-4bca-ae9f-d26bc36a5362 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:34.933913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c159b6ba-7fdf-4bca-ae9f-d26bc36a5362 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:34.934685 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c159b6ba-7fdf-4bca-ae9f-d26bc36a5362 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:34.935117 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c159b6ba-7fdf-4bca-ae9f-d26bc36a5362 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:35.069072 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c159b6ba-7fdf-4bca-ae9f-d26bc36a5362 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:35.078296 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c159b6ba-7fdf-4bca-ae9f-d26bc36a5362 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:35.079848 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c159b6ba-7fdf-4bca-ae9f-d26bc36a5362 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:35.081053 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c159b6ba-7fdf-4bca-ae9f-d26bc36a5362 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.159056 Jul 26 12:58:35.081578 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 447/901] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:58:34 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 12:58:36.105728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c47ec5be-bf3c-4598-ba42-1841fb40c450 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:36.106417 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c47ec5be-bf3c-4598-ba42-1841fb40c450 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:36.112959 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c47ec5be-bf3c-4598-ba42-1841fb40c450 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:36.113408 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c47ec5be-bf3c-4598-ba42-1841fb40c450 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:36.114163 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c47ec5be-bf3c-4598-ba42-1841fb40c450 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:36.114595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c47ec5be-bf3c-4598-ba42-1841fb40c450 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:36.245703 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c47ec5be-bf3c-4598-ba42-1841fb40c450 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:36.253664 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c47ec5be-bf3c-4598-ba42-1841fb40c450 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:36.255179 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c47ec5be-bf3c-4598-ba42-1841fb40c450 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:36.256633 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c47ec5be-bf3c-4598-ba42-1841fb40c450 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1726 microversion: 2.20 time: 0.155810 Jul 26 12:58:36.257196 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 455/902] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:58:36 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:58:37.286579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ba6616ec-6dee-409a-9914-579babb1bd52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:37.288979 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ba6616ec-6dee-409a-9914-579babb1bd52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:37.296404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ba6616ec-6dee-409a-9914-579babb1bd52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:37.296849 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ba6616ec-6dee-409a-9914-579babb1bd52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:37.297789 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ba6616ec-6dee-409a-9914-579babb1bd52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:37.298367 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ba6616ec-6dee-409a-9914-579babb1bd52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:37.345156 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-7605044e-8f43-40b8-9804-c5dc1681d27b req-43ea8689-c9a8-43fc-bd59-716836776eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "146eb1e1-e26e-4f91-ad22-2cf7926f8b93", "name": "network-vif-deleted", "tag": "542d7fcb-23e0-4cab-98aa-203a4db90c44"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:37.367216 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-7605044e-8f43-40b8-9804-c5dc1681d27b req-43ea8689-c9a8-43fc-bd59-716836776eb8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:37.370460 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-7605044e-8f43-40b8-9804-c5dc1681d27b req-43ea8689-c9a8-43fc-bd59-716836776eb8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:37.382176 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ba6616ec-6dee-409a-9914-579babb1bd52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:37.391054 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-7605044e-8f43-40b8-9804-c5dc1681d27b req-43ea8689-c9a8-43fc-bd59-716836776eb8 service nova] Creating event network-vif-deleted:542d7fcb-23e0-4cab-98aa-203a4db90c44 for instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 on hv-cinder-85093 Jul 26 12:58:37.397346 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-7605044e-8f43-40b8-9804-c5dc1681d27b req-43ea8689-c9a8-43fc-bd59-716836776eb8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056930 Jul 26 12:58:37.398305 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ba6616ec-6dee-409a-9914-579babb1bd52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:37.399389 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 456/903] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:37.400712 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ba6616ec-6dee-409a-9914-579babb1bd52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '17b7e2c1b1b04366b99e9ab892aeb835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93dd858fb7a40fbbb679fbe676b1f3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:37.402014 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ba6616ec-6dee-409a-9914-579babb1bd52 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 200 len: 1658 microversion: 2.20 time: 0.119301 Jul 26 12:58:37.403408 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 448/904] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:58:37 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 1658 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 12:58:38.427090 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ad176328-20c2-4e0b-bbef-9dd1efe8b67c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:38.428099 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ad176328-20c2-4e0b-bbef-9dd1efe8b67c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:38.434809 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ad176328-20c2-4e0b-bbef-9dd1efe8b67c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:38.435265 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ad176328-20c2-4e0b-bbef-9dd1efe8b67c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:38.436072 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ad176328-20c2-4e0b-bbef-9dd1efe8b67c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:38.436514 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ad176328-20c2-4e0b-bbef-9dd1efe8b67c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:38.440735 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:38.450999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-ad176328-20c2-4e0b-bbef-9dd1efe8b67c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] HTTP exception thrown: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ad176328-20c2-4e0b-bbef-9dd1efe8b67c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Request method failure captured: Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 HTTP/1.1 Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NPAWW1NBdMRtqW3YqJgaBR_jRTQlhyTkofW4Txb48VZtZWOfmn7eNQimrkw3fjzuDkk61QqxSjhECSPCYfBaUc3Xi9DvazYxnpgAXFRskkbxiK_Nu-Q3Sy0NhyGYgojG405CAt9EYtcyaiT1UjOSUzIXoCaANw1wCbIVlZZDQuNHo Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: a93dd858fb7a40fbbb679fbe676b1f3c Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:58:38.452729 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:58:38.454467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a93dd858fb7a40fbbb679fbe676b1f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a93dd858fb7a40fbbb679fbe676b1f3c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a93dd858fb7a40fbbb679fbe676b1f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a93dd858fb7a40fbbb679fbe676b1f3c"}]}] Jul 26 12:58:38.454467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:38.454467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: a93dd858fb7a40fbbb679fbe676b1f3c Jul 26 12:58:38.454467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:38.454467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeShelveTestJSON-2123661871-project Jul 26 12:58:38.454467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:58:38.454467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:58:38.454467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 17b7e2c1b1b04366b99e9ab892aeb835 Jul 26 12:58:38.454467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2123661871-project Jul 26 12:58:38.454467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:58:38.454467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:38.454467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '146eb1e1-e26e-4f91-ad22-2cf7926f8b93'} Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:38.455375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:38.456961 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:38.458390 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ad176328-20c2-4e0b-bbef-9dd1efe8b67c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Returning 404 to user: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:38.458390 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ad176328-20c2-4e0b-bbef-9dd1efe8b67c tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 404 len: 111 microversion: 2.20 time: 0.032131 Jul 26 12:58:38.458390 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 457/905] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:58:38 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 12:58:38.463623 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e08f2964-d882-40bf-9aae-1cc6363ad92b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '.version_select at 0x7f65f9b3e9d0>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:38.482593 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e08f2964-d882-40bf-9aae-1cc6363ad92b tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346370454" status: 204 len: 0 microversion: 2.20 time: 0.023383 Jul 26 12:58:38.483184 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 449/906] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Jul 26 12:58:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346370454 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 12:58:40.246363 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6545841b-74cf-4bb0-a931-1a9fd3a759aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:40.246889 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-6545841b-74cf-4bb0-a931-1a9fd3a759aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:40.254696 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6545841b-74cf-4bb0-a931-1a9fd3a759aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:40.255145 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6545841b-74cf-4bb0-a931-1a9fd3a759aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:40.256209 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6545841b-74cf-4bb0-a931-1a9fd3a759aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:40.256646 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6545841b-74cf-4bb0-a931-1a9fd3a759aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:40.270494 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-6545841b-74cf-4bb0-a931-1a9fd3a759aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] HTTP exception thrown: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6545841b-74cf-4bb0-a931-1a9fd3a759aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Request method failure captured: Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: DELETE /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 HTTP/1.1 Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NPAWW1NBdMRtqW3YqJgaBR_jRTQlhyTkofW4Txb48VZtZWOfmn7eNQimrkw3fjzuDkk61QqxSjhECSPCYfBaUc3Xi9DvazYxnpgAXFRskkbxiK_Nu-Q3Sy0NhyGYgojG405CAt9EYtcyaiT1UjOSUzIXoCaANw1wCbIVlZZDQuNHo Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: a93dd858fb7a40fbbb679fbe676b1f3c Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:58:40.272065 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:58:40.274341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a93dd858fb7a40fbbb679fbe676b1f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a93dd858fb7a40fbbb679fbe676b1f3c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a93dd858fb7a40fbbb679fbe676b1f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a93dd858fb7a40fbbb679fbe676b1f3c"}]}] Jul 26 12:58:40.274341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:40.274341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: a93dd858fb7a40fbbb679fbe676b1f3c Jul 26 12:58:40.274341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:40.274341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeShelveTestJSON-2123661871-project Jul 26 12:58:40.274341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:58:40.274341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:58:40.274341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 17b7e2c1b1b04366b99e9ab892aeb835 Jul 26 12:58:40.274341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2123661871-project Jul 26 12:58:40.274341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:58:40.274341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:40.274341 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '146eb1e1-e26e-4f91-ad22-2cf7926f8b93'} Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:40.275297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:40.276808 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:40.278411 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6545841b-74cf-4bb0-a931-1a9fd3a759aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Returning 404 to user: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:40.278411 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-6545841b-74cf-4bb0-a931-1a9fd3a759aa tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "DELETE /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 404 len: 111 microversion: 2.20 time: 0.031058 Jul 26 12:58:40.278411 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 458/907] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Jul 26 12:58:40 2022] DELETE /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 12:58:40.282788 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ed6ef1d3-5da2-4e03-ad25-dd7162bfb675 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:40.283404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ed6ef1d3-5da2-4e03-ad25-dd7162bfb675 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 146eb1e1-e26e-4f91-ad22-2cf7926f8b93] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:40.290768 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed6ef1d3-5da2-4e03-ad25-dd7162bfb675 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:40.291223 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed6ef1d3-5da2-4e03-ad25-dd7162bfb675 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:40.292035 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed6ef1d3-5da2-4e03-ad25-dd7162bfb675 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:40.292477 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed6ef1d3-5da2-4e03-ad25-dd7162bfb675 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:40.307874 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-ed6ef1d3-5da2-4e03-ad25-dd7162bfb675 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] HTTP exception thrown: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ed6ef1d3-5da2-4e03-ad25-dd7162bfb675 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Request method failure captured: Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 HTTP/1.1 Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-NPAWW1NBdMRtqW3YqJgaBR_jRTQlhyTkofW4Txb48VZtZWOfmn7eNQimrkw3fjzuDkk61QqxSjhECSPCYfBaUc3Xi9DvazYxnpgAXFRskkbxiK_Nu-Q3Sy0NhyGYgojG405CAt9EYtcyaiT1UjOSUzIXoCaANw1wCbIVlZZDQuNHo Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: a93dd858fb7a40fbbb679fbe676b1f3c Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:58:40.309521 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:58:40.311319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a93dd858fb7a40fbbb679fbe676b1f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a93dd858fb7a40fbbb679fbe676b1f3c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a93dd858fb7a40fbbb679fbe676b1f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a93dd858fb7a40fbbb679fbe676b1f3c"}]}] Jul 26 12:58:40.311319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:40.311319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: a93dd858fb7a40fbbb679fbe676b1f3c Jul 26 12:58:40.311319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:40.311319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-AttachVolumeShelveTestJSON-2123661871-project Jul 26 12:58:40.311319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:58:40.311319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:58:40.311319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 17b7e2c1b1b04366b99e9ab892aeb835 Jul 26 12:58:40.311319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2123661871-project Jul 26 12:58:40.311319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:58:40.311319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:40.311319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '146eb1e1-e26e-4f91-ad22-2cf7926f8b93'} Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:40.312343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. Jul 26 12:58:40.313806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:40.315506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ed6ef1d3-5da2-4e03-ad25-dd7162bfb675 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Returning 404 to user: Instance 146eb1e1-e26e-4f91-ad22-2cf7926f8b93 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:40.315506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ed6ef1d3-5da2-4e03-ad25-dd7162bfb675 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93" status: 404 len: 111 microversion: 2.20 time: 0.032093 Jul 26 12:58:40.315506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 450/908] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:58:40 2022] GET /compute/v2.1/servers/146eb1e1-e26e-4f91-ad22-2cf7926f8b93 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 12:58:41.456274 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-81facba6-c34f-449a-9f0e-627c33f62161 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:41.456824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-81facba6-c34f-449a-9f0e-627c33f62161 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:41.462959 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-81facba6-c34f-449a-9f0e-627c33f62161 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:41.463399 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-81facba6-c34f-449a-9f0e-627c33f62161 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:41.464202 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-81facba6-c34f-449a-9f0e-627c33f62161 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:41.464639 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-81facba6-c34f-449a-9f0e-627c33f62161 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:41.478058 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-81facba6-c34f-449a-9f0e-627c33f62161 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] HTTP exception thrown: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-81facba6-c34f-449a-9f0e-627c33f62161 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Request method failure captured: Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: DELETE /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 HTTP/1.1 Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-NPAWW1NBdMRtqW3YqJgaBR_jRTQlhyTkofW4Txb48VZtZWOfmn7eNQimrkw3fjzuDkk61QqxSjhECSPCYfBaUc3Xi9DvazYxnpgAXFRskkbxiK_Nu-Q3Sy0NhyGYgojG405CAt9EYtcyaiT1UjOSUzIXoCaANw1wCbIVlZZDQuNHo Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: a93dd858fb7a40fbbb679fbe676b1f3c Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:58:41.479617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:58:41.481333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a93dd858fb7a40fbbb679fbe676b1f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a93dd858fb7a40fbbb679fbe676b1f3c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a93dd858fb7a40fbbb679fbe676b1f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a93dd858fb7a40fbbb679fbe676b1f3c"}]}] Jul 26 12:58:41.481333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:41.481333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: a93dd858fb7a40fbbb679fbe676b1f3c Jul 26 12:58:41.481333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:41.481333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeShelveTestJSON-2123661871-project Jul 26 12:58:41.481333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:58:41.481333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:58:41.481333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 17b7e2c1b1b04366b99e9ab892aeb835 Jul 26 12:58:41.481333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2123661871-project Jul 26 12:58:41.481333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:58:41.481333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:58:41.481333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '20220b7e-2897-4f0c-98da-3f352aa39ec2'} Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:41.482228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:58:41.483435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:41.484749 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-81facba6-c34f-449a-9f0e-627c33f62161 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Returning 404 to user: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:41.484749 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-81facba6-c34f-449a-9f0e-627c33f62161 tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 404 len: 111 microversion: 2.20 time: 0.029079 Jul 26 12:58:41.484749 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 459/909] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Jul 26 12:58:41 2022] DELETE /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 12:58:41.489762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ffe085d8-8e8d-4a59-9312-cf05add37d7e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:41.490374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ffe085d8-8e8d-4a59-9312-cf05add37d7e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] [instance: 20220b7e-2897-4f0c-98da-3f352aa39ec2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:41.497631 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ffe085d8-8e8d-4a59-9312-cf05add37d7e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:41.498232 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ffe085d8-8e8d-4a59-9312-cf05add37d7e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:41.499050 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ffe085d8-8e8d-4a59-9312-cf05add37d7e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:41.499557 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ffe085d8-8e8d-4a59-9312-cf05add37d7e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:41.670877 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-ffe085d8-8e8d-4a59-9312-cf05add37d7e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] HTTP exception thrown: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ffe085d8-8e8d-4a59-9312-cf05add37d7e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Request method failure captured: Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 HTTP/1.1 Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-NPAWW1NBdMRtqW3YqJgaBR_jRTQlhyTkofW4Txb48VZtZWOfmn7eNQimrkw3fjzuDkk61QqxSjhECSPCYfBaUc3Xi9DvazYxnpgAXFRskkbxiK_Nu-Q3Sy0NhyGYgojG405CAt9EYtcyaiT1UjOSUzIXoCaANw1wCbIVlZZDQuNHo Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: a93dd858fb7a40fbbb679fbe676b1f3c Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:58:41.674905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:58:41.676528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a93dd858fb7a40fbbb679fbe676b1f3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a93dd858fb7a40fbbb679fbe676b1f3c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a93dd858fb7a40fbbb679fbe676b1f3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a93dd858fb7a40fbbb679fbe676b1f3c"}]}] Jul 26 12:58:41.676528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:41.676528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: a93dd858fb7a40fbbb679fbe676b1f3c Jul 26 12:58:41.676528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2123661871 Jul 26 12:58:41.676528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-AttachVolumeShelveTestJSON-2123661871-project Jul 26 12:58:41.676528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:58:41.676528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:58:41.676528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 17b7e2c1b1b04366b99e9ab892aeb835 Jul 26 12:58:41.676528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2123661871-project Jul 26 12:58:41.676528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 12:58:41.676528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:58:41.676528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '20220b7e-2897-4f0c-98da-3f352aa39ec2'} Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:41.677382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. Jul 26 12:58:41.678555 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:41.680537 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ffe085d8-8e8d-4a59-9312-cf05add37d7e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] Returning 404 to user: Instance 20220b7e-2897-4f0c-98da-3f352aa39ec2 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:41.680537 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ffe085d8-8e8d-4a59-9312-cf05add37d7e tempest-AttachVolumeShelveTestJSON-2123661871 tempest-AttachVolumeShelveTestJSON-2123661871-project] 10.222.0.20 "GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2" status: 404 len: 111 microversion: 2.20 time: 0.187968 Jul 26 12:58:41.680537 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 451/910] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Jul 26 12:58:41 2022] GET /compute/v2.1/servers/20220b7e-2897-4f0c-98da-3f352aa39ec2 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 12:58:46.515615 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-086ed9c8-170b-44e4-9bdb-a2874d20b4d3 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Action: 'create', calling method: .version_select at 0x7f65f5437dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-516757340"}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:46.847155 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-086ed9c8-170b-44e4-9bdb-a2874d20b4d3 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.473700 Jul 26 12:58:46.847944 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 460/911] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Jul 26 12:58:46 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 475 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 12:58:46.860446 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-08f4c533-0171-4a7e-a266-91df1fb93355 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f9b29af0>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:46.913713 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-08f4c533-0171-4a7e-a266-91df1fb93355 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f" status: 200 len: 344 microversion: 2.1 time: 0.057201 Jul 26 12:58:46.914417 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 452/912] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 12:58:46 2022] GET /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:47.927103 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9965a4b0-bde8-4691-93db-b019d19972cb tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f54d71f0>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:47.982118 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9965a4b0-bde8-4691-93db-b019d19972cb tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f" status: 200 len: 345 microversion: 2.1 time: 0.059294 Jul 26 12:58:47.983241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 461/913] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 12:58:47 2022] GET /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:47.991821 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1075126103", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "networks": [{"uuid": "c283aae5-6242-48a3-b842-d996f4419472"}]}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:47.996638 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-39c794eb-fdb4-4200-b79a-951e5a27a988 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Action: 'create', calling method: .version_select at 0x7f65f56630d0>, body: {"snapshot": {"volume_id": "45a2f88a-d458-495e-a556-ac0db37afb5f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1403649567"}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:48.001391 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:48.056592 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.network.neutron [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] validate_networks() for [('c283aae5-6242-48a3-b842-d996f4419472', None, None, None, None, None)] {{(pid=129308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:58:48.162225 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-39c794eb-fdb4-4200-b79a-951e5a27a988 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.170402 Jul 26 12:58:48.163030 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 462/914] 10.222.0.20 () {60 vars in 1162 bytes} [Tue Jul 26 12:58:47 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:58:48.178339 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6d3719b8-04b3-48ff-b51a-56db0b0506c7 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f5400280>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:48.210010 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-6d3719b8-04b3-48ff-b51a-56db0b0506c7 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b" status: 200 len: 287 microversion: 2.1 time: 0.038287 Jul 26 12:58:48.210600 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 463/915] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Jul 26 12:58:48 2022] GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:48.222246 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-44ffbfe5-b546-4d66-96ec-699abf131c17 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f55da940>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:48.253295 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-44ffbfe5-b546-4d66-96ec-699abf131c17 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034756 Jul 26 12:58:48.253857 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 464/916] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Jul 26 12:58:48 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:58:48.265257 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8701fda0-8cc1-47ef-8ae6-f2aacd47e64e tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f54d70d0>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:48.296877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8701fda0-8cc1-47ef-8ae6-f2aacd47e64e tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b" status: 200 len: 287 microversion: 2.1 time: 0.035289 Jul 26 12:58:48.297440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 465/917] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Jul 26 12:58:48 2022] GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:58:48.424646 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Flavor limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:58:48.425074 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Image limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:58:48.425551 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Flavor pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:58:48.425966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Image pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:58:48.426415 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:58:48.435324 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:48.435825 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:48.436628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:48.437078 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:48.453893 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Getting quotas for project dc0f5db491bd494d943de6bf1084c1a5. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:58:48.457825 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Getting quotas for user 8e8b5c62a961409baaaa101f61437f1e and project dc0f5db491bd494d943de6bf1084c1a5. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:58:48.469220 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Going to run 1 instances... {{(pid=129308) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:58:48.471431 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:58:48.517695 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-2dcb050f-a4dd-4bab-bc34-618c7236f11c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530150 Jul 26 12:58:48.518335 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 453/918] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:58:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 26 12:58:48.529766 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-677024b9-2a65-4180-8252-9270160cb1d5 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:48.530479 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-677024b9-2a65-4180-8252-9270160cb1d5 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:48.585170 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-677024b9-2a65-4180-8252-9270160cb1d5 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:48.592527 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-677024b9-2a65-4180-8252-9270160cb1d5 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1214 microversion: 2.1 time: 0.067168 Jul 26 12:58:48.593288 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 466/919] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:48 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:49.310816 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-238edcd9-a4e4-495f-b892-a64c4e4b45b1 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f9b0c8b0>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:49.340621 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-238edcd9-a4e4-495f-b892-a64c4e4b45b1 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b" status: 200 len: 287 microversion: 2.1 time: 0.034744 Jul 26 12:58:49.341176 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 454/920] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Jul 26 12:58:49 2022] GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:49.612689 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-313bfd1f-4f42-4632-bd0a-94bd69f87ebf tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:49.613304 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-313bfd1f-4f42-4632-bd0a-94bd69f87ebf tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:49.620450 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-313bfd1f-4f42-4632-bd0a-94bd69f87ebf tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:49.620914 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-313bfd1f-4f42-4632-bd0a-94bd69f87ebf tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:49.621682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-313bfd1f-4f42-4632-bd0a-94bd69f87ebf tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:49.622124 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-313bfd1f-4f42-4632-bd0a-94bd69f87ebf tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:49.684125 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-313bfd1f-4f42-4632-bd0a-94bd69f87ebf tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:49.691620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-313bfd1f-4f42-4632-bd0a-94bd69f87ebf tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1218 microversion: 2.1 time: 0.082824 Jul 26 12:58:49.692223 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 467/921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:49 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:50.353170 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a463b235-b871-4ee8-bace-0dbe2abf004f tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f5204a60>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:50.386384 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a463b235-b871-4ee8-bace-0dbe2abf004f tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b" status: 200 len: 287 microversion: 2.1 time: 0.037427 Jul 26 12:58:50.386939 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 455/922] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Jul 26 12:58:50 2022] GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:50.713429 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9b5dc10e-68d5-4aa2-b1e5-6058ebac5ace tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:50.714045 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9b5dc10e-68d5-4aa2-b1e5-6058ebac5ace tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:50.720673 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9b5dc10e-68d5-4aa2-b1e5-6058ebac5ace tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:50.721129 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9b5dc10e-68d5-4aa2-b1e5-6058ebac5ace tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:50.721896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9b5dc10e-68d5-4aa2-b1e5-6058ebac5ace tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:50.722336 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9b5dc10e-68d5-4aa2-b1e5-6058ebac5ace tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:50.786091 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9b5dc10e-68d5-4aa2-b1e5-6058ebac5ace tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:50.794251 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9b5dc10e-68d5-4aa2-b1e5-6058ebac5ace tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1210 microversion: 2.1 time: 0.084671 Jul 26 12:58:50.794828 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 468/923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:50 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:51.399009 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9dd6c69e-385d-4b2f-85e7-8d2e54f5f12b tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f9b0cf70>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:51.431821 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9dd6c69e-385d-4b2f-85e7-8d2e54f5f12b tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b" status: 200 len: 288 microversion: 2.1 time: 0.037197 Jul 26 12:58:51.432623 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 456/924] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Jul 26 12:58:51 2022] GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:51.443941 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f9d57a2b-aa23-47cf-a265-adaa8480ad6f tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f54d7430>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:51.517073 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f9d57a2b-aa23-47cf-a265-adaa8480ad6f tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b" status: 202 len: 0 microversion: 2.1 time: 0.077157 Jul 26 12:58:51.518050 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 469/925] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Jul 26 12:58:51 2022] DELETE /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 12:58:51.527896 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e0366547-4445-4b72-8364-b55463ebef7c tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f9b29430>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:51.574337 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e0366547-4445-4b72-8364-b55463ebef7c tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b" status: 200 len: 287 microversion: 2.1 time: 0.051209 Jul 26 12:58:51.576287 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 457/926] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Jul 26 12:58:51 2022] GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:51.815776 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-3dc87d18-1025-46df-984f-db6cd6bae6ae tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:51.817013 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-3dc87d18-1025-46df-984f-db6cd6bae6ae tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:51.823529 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3dc87d18-1025-46df-984f-db6cd6bae6ae tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:51.824008 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3dc87d18-1025-46df-984f-db6cd6bae6ae tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:51.824769 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3dc87d18-1025-46df-984f-db6cd6bae6ae tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:51.825204 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-3dc87d18-1025-46df-984f-db6cd6bae6ae tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:51.887581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-3dc87d18-1025-46df-984f-db6cd6bae6ae tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:51.896449 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-3dc87d18-1025-46df-984f-db6cd6bae6ae tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1272 microversion: 2.1 time: 0.085008 Jul 26 12:58:51.897128 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 470/927] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:51 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:52.590059 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c4088c95-8bb1-4ae3-b6e1-050500525d76 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f51ef9d0>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:52.619745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-c4088c95-8bb1-4ae3-b6e1-050500525d76 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] HTTP exception thrown: Snapshot ba3106de-2ec3-44fe-9ded-b875af8ec95b could not be found. Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c4088c95-8bb1-4ae3-b6e1-050500525d76 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Request method failure captured: Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b HTTP/1.1 Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-UGcuhP77mJjpZ58XTyVlmZp7-KsR_gfQh0K1ZtjQNWGkQNsG6HH9CBtOTzEWoDXG0abIrJXZN5N1JJ_tqEjL3g-iaBECSq2YvHMrzqv8SMN3e1ZFYsXExsmSTFdUVk3xG1Vj72u3cWjXSPQfmCUVQMOT_6rMnYqvKBqvbu0S7FZEU Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: cf380877d2614eae80ecc2d8530bfa99 Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1638262769 Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:58:52.622029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:58:52.623666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf380877d2614eae80ecc2d8530bfa99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf380877d2614eae80ecc2d8530bfa99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf380877d2614eae80ecc2d8530bfa99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf380877d2614eae80ecc2d8530bfa99"}]}] Jul 26 12:58:52.623666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1638262769 Jul 26 12:58:52.623666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: cf380877d2614eae80ecc2d8530bfa99 Jul 26 12:58:52.623666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1638262769 Jul 26 12:58:52.623666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-VolumesSnapshotsTestJSON-1638262769-project Jul 26 12:58:52.623666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:58:52.623666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:58:52.623666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 3b3d1dc6079d415b8eaafca6ec1cacc4 Jul 26 12:58:52.623666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1638262769-project Jul 26 12:58:52.623666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: Jul 26 12:58:52.623666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Snapshot ba3106de-2ec3-44fe-9ded-b875af8ec95b could not be found. Jul 26 12:58:52.623666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': 'ba3106de-2ec3-44fe-9ded-b875af8ec95b'} Jul 26 12:58:52.623666 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ba3106de-2ec3-44fe-9ded-b875af8ec95b could not be found. (HTTP 404) (Request-ID: req-bb21271f-4683-42d8-8eb8-f37b3e6334e3) Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:52.624772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 12:58:52.626130 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ba3106de-2ec3-44fe-9ded-b875af8ec95b could not be found. Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 26 12:58:52.627506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:52.629095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ba3106de-2ec3-44fe-9ded-b875af8ec95b could not be found. Jul 26 12:58:52.629095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:52.629095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:52.629095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:52.629095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:52.629095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:52.629095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:52.629095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:52.629095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:52.629095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ba3106de-2ec3-44fe-9ded-b875af8ec95b could not be found. Jul 26 12:58:52.629095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:52.629095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c4088c95-8bb1-4ae3-b6e1-050500525d76 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Returning 404 to user: Snapshot ba3106de-2ec3-44fe-9ded-b875af8ec95b could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:52.629095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c4088c95-8bb1-4ae3-b6e1-050500525d76 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b" status: 404 len: 111 microversion: 2.1 time: 0.038480 Jul 26 12:58:52.630413 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 458/928] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Jul 26 12:58:52 2022] GET /compute/v2.1/os-snapshots/ba3106de-2ec3-44fe-9ded-b875af8ec95b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:58:52.632791 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c3fd4206-a692-4eb6-b517-94f734204f65 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f5353280>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:52.695901 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c3fd4206-a692-4eb6-b517-94f734204f65 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f" status: 202 len: 0 microversion: 2.1 time: 0.067043 Jul 26 12:58:52.696650 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 471/929] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Jul 26 12:58:52 2022] DELETE /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:58:52.705537 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ea0cad99-fdb8-45a1-8fec-4acb85c50825 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f9b0ce50>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:52.755400 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ea0cad99-fdb8-45a1-8fec-4acb85c50825 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f" status: 200 len: 344 microversion: 2.1 time: 0.054380 Jul 26 12:58:52.755974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 459/930] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 12:58:52 2022] GET /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:52.772435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-bcf55065-9029-4fae-822a-421e5a4863e0 req-38173e71-25e3-44a8-8175-de1d045e58d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e32990-d7a8-4da5-8bc6-37e1b217299f", "tag": "9dd6aecf-51d4-4555-8b77-cf1e5ab81185"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:52.784736 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-bcf55065-9029-4fae-822a-421e5a4863e0 req-38173e71-25e3-44a8-8175-de1d045e58d8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:52.785263 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-bcf55065-9029-4fae-822a-421e5a4863e0 req-38173e71-25e3-44a8-8175-de1d045e58d8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:52.797652 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-bcf55065-9029-4fae-822a-421e5a4863e0 req-38173e71-25e3-44a8-8175-de1d045e58d8 service nova] Creating event network-changed:9dd6aecf-51d4-4555-8b77-cf1e5ab81185 for instance 83e32990-d7a8-4da5-8bc6-37e1b217299f on hv-cinder-85093 Jul 26 12:58:52.802464 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-bcf55065-9029-4fae-822a-421e5a4863e0 req-38173e71-25e3-44a8-8175-de1d045e58d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034645 Jul 26 12:58:52.803064 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 472/931] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:52.918123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f8cb8eb3-203f-4c97-b29e-6f9a8a119e4b tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:52.919129 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f8cb8eb3-203f-4c97-b29e-6f9a8a119e4b tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:52.926583 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8cb8eb3-203f-4c97-b29e-6f9a8a119e4b tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:52.927036 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8cb8eb3-203f-4c97-b29e-6f9a8a119e4b tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:52.927851 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8cb8eb3-203f-4c97-b29e-6f9a8a119e4b tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:52.928294 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8cb8eb3-203f-4c97-b29e-6f9a8a119e4b tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:52.930985 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:53.139209 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f8cb8eb3-203f-4c97-b29e-6f9a8a119e4b tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:53.146635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f8cb8eb3-203f-4c97-b29e-6f9a8a119e4b tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1314 microversion: 2.1 time: 0.233482 Jul 26 12:58:53.147202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 460/932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:52 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:58:53.770802 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e8b590e0-49a7-42f8-8479-89d153c53dcd tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f54d7550>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:53.798728 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-e8b590e0-49a7-42f8-8479-89d153c53dcd tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] HTTP exception thrown: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e8b590e0-49a7-42f8-8479-89d153c53dcd tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Request method failure captured: Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f HTTP/1.1 Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-UGcuhP77mJjpZ58XTyVlmZp7-KsR_gfQh0K1ZtjQNWGkQNsG6HH9CBtOTzEWoDXG0abIrJXZN5N1JJ_tqEjL3g-iaBECSq2YvHMrzqv8SMN3e1ZFYsXExsmSTFdUVk3xG1Vj72u3cWjXSPQfmCUVQMOT_6rMnYqvKBqvbu0S7FZEU Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: cf380877d2614eae80ecc2d8530bfa99 Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1638262769 Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:58:53.800854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:58:53.802523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf380877d2614eae80ecc2d8530bfa99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf380877d2614eae80ecc2d8530bfa99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf380877d2614eae80ecc2d8530bfa99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf380877d2614eae80ecc2d8530bfa99"}]}] Jul 26 12:58:53.802523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1638262769 Jul 26 12:58:53.802523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: cf380877d2614eae80ecc2d8530bfa99 Jul 26 12:58:53.802523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1638262769 Jul 26 12:58:53.802523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-VolumesSnapshotsTestJSON-1638262769-project Jul 26 12:58:53.802523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:58:53.802523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:58:53.802523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 3b3d1dc6079d415b8eaafca6ec1cacc4 Jul 26 12:58:53.802523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1638262769-project Jul 26 12:58:53.802523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: Jul 26 12:58:53.802523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.802523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '45a2f88a-d458-495e-a556-ac0db37afb5f'} Jul 26 12:58:53.802523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. (HTTP 404) (Request-ID: req-c8ec7f44-f7b2-4dcc-8b3a-e2ee6b1c5188) Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:53.803581 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 12:58:53.804999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 12:58:53.806709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e8b590e0-49a7-42f8-8479-89d153c53dcd tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Returning 404 to user: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e8b590e0-49a7-42f8-8479-89d153c53dcd tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f" status: 404 len: 109 microversion: 2.1 time: 0.036166 Jul 26 12:58:53.808028 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 473/933] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 12:58:53 2022] GET /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:58:53.817166 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b6c5e6d5-a759-417d-aba3-1b0bd95281a5 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f71f7280>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:53.844467 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-b6c5e6d5-a759-417d-aba3-1b0bd95281a5 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] HTTP exception thrown: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b6c5e6d5-a759-417d-aba3-1b0bd95281a5 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Request method failure captured: Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: DELETE /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f HTTP/1.1 Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-UGcuhP77mJjpZ58XTyVlmZp7-KsR_gfQh0K1ZtjQNWGkQNsG6HH9CBtOTzEWoDXG0abIrJXZN5N1JJ_tqEjL3g-iaBECSq2YvHMrzqv8SMN3e1ZFYsXExsmSTFdUVk3xG1Vj72u3cWjXSPQfmCUVQMOT_6rMnYqvKBqvbu0S7FZEU Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: cf380877d2614eae80ecc2d8530bfa99 Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1638262769 Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 12:58:53.846404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 12:58:53.847966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf380877d2614eae80ecc2d8530bfa99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf380877d2614eae80ecc2d8530bfa99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf380877d2614eae80ecc2d8530bfa99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf380877d2614eae80ecc2d8530bfa99"}]}] Jul 26 12:58:53.847966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1638262769 Jul 26 12:58:53.847966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: cf380877d2614eae80ecc2d8530bfa99 Jul 26 12:58:53.847966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1638262769 Jul 26 12:58:53.847966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-VolumesSnapshotsTestJSON-1638262769-project Jul 26 12:58:53.847966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 12:58:53.847966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 12:58:53.847966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 3b3d1dc6079d415b8eaafca6ec1cacc4 Jul 26 12:58:53.847966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1638262769-project Jul 26 12:58:53.847966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: Jul 26 12:58:53.847966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.847966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '45a2f88a-d458-495e-a556-ac0db37afb5f'} Jul 26 12:58:53.847966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. (HTTP 404) (Request-ID: req-59f65268-f1d6-497f-a025-8c5e1a84eec6) Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:53.848902 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 12:58:53.850297 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 12:58:53.851622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b6c5e6d5-a759-417d-aba3-1b0bd95281a5 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Returning 404 to user: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b6c5e6d5-a759-417d-aba3-1b0bd95281a5 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f" status: 404 len: 109 microversion: 2.1 time: 0.034525 Jul 26 12:58:53.853511 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 461/934] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Jul 26 12:58:53 2022] DELETE /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:58:53.856629 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2bc7d21e-69e8-4b1d-a40a-de52654fafb7 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Calling method '.version_select at 0x7f65f53b79d0>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:53.884869 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-2bc7d21e-69e8-4b1d-a40a-de52654fafb7 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] HTTP exception thrown: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2bc7d21e-69e8-4b1d-a40a-de52654fafb7 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Request method failure captured: Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f HTTP/1.1 Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-UGcuhP77mJjpZ58XTyVlmZp7-KsR_gfQh0K1ZtjQNWGkQNsG6HH9CBtOTzEWoDXG0abIrJXZN5N1JJ_tqEjL3g-iaBECSq2YvHMrzqv8SMN3e1ZFYsXExsmSTFdUVk3xG1Vj72u3cWjXSPQfmCUVQMOT_6rMnYqvKBqvbu0S7FZEU Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: cf380877d2614eae80ecc2d8530bfa99 Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1638262769 Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:58:53.886906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:58:53.888439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf380877d2614eae80ecc2d8530bfa99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf380877d2614eae80ecc2d8530bfa99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf380877d2614eae80ecc2d8530bfa99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf380877d2614eae80ecc2d8530bfa99"}]}] Jul 26 12:58:53.888439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1638262769 Jul 26 12:58:53.888439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: cf380877d2614eae80ecc2d8530bfa99 Jul 26 12:58:53.888439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1638262769 Jul 26 12:58:53.888439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-VolumesSnapshotsTestJSON-1638262769-project Jul 26 12:58:53.888439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:58:53.888439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:58:53.888439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 3b3d1dc6079d415b8eaafca6ec1cacc4 Jul 26 12:58:53.888439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1638262769-project Jul 26 12:58:53.888439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: Jul 26 12:58:53.888439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.888439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '45a2f88a-d458-495e-a556-ac0db37afb5f'} Jul 26 12:58:53.888439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. (HTTP 404) (Request-ID: req-586ba711-daa0-40fb-8cf8-76e39b22f607) Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:53.889385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 12:58:53.890860 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 12:58:53.892384 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2bc7d21e-69e8-4b1d-a40a-de52654fafb7 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] Returning 404 to user: Volume 45a2f88a-d458-495e-a556-ac0db37afb5f could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2bc7d21e-69e8-4b1d-a40a-de52654fafb7 tempest-VolumesSnapshotsTestJSON-1638262769 tempest-VolumesSnapshotsTestJSON-1638262769-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f" status: 404 len: 109 microversion: 2.1 time: 0.035973 Jul 26 12:58:53.893825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 474/935] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 12:58:53 2022] GET /compute/v2.1/os-volumes/45a2f88a-d458-495e-a556-ac0db37afb5f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 12:58:54.169863 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-97655ce7-0bae-4d6f-b014-2dd8caeb6b5e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:54.171064 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-97655ce7-0bae-4d6f-b014-2dd8caeb6b5e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:54.182573 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-97655ce7-0bae-4d6f-b014-2dd8caeb6b5e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:54.184290 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-97655ce7-0bae-4d6f-b014-2dd8caeb6b5e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:54.185093 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-97655ce7-0bae-4d6f-b014-2dd8caeb6b5e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:54.185537 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-97655ce7-0bae-4d6f-b014-2dd8caeb6b5e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:54.427434 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-97655ce7-0bae-4d6f-b014-2dd8caeb6b5e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:54.435242 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-97655ce7-0bae-4d6f-b014-2dd8caeb6b5e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1314 microversion: 2.1 time: 0.270755 Jul 26 12:58:54.435933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 462/936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:54 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:55.457295 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b0bc8fd2-e3ac-45b9-a600-db0fea53a3e8 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:55.458113 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b0bc8fd2-e3ac-45b9-a600-db0fea53a3e8 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:55.465790 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b0bc8fd2-e3ac-45b9-a600-db0fea53a3e8 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:55.466315 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b0bc8fd2-e3ac-45b9-a600-db0fea53a3e8 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:55.467171 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b0bc8fd2-e3ac-45b9-a600-db0fea53a3e8 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:55.467708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b0bc8fd2-e3ac-45b9-a600-db0fea53a3e8 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:55.607578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b0bc8fd2-e3ac-45b9-a600-db0fea53a3e8 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:55.614994 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b0bc8fd2-e3ac-45b9-a600-db0fea53a3e8 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1314 microversion: 2.1 time: 0.162138 Jul 26 12:58:55.615546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 475/937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:55 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:56.635933 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d126b8fa-1cc8-4c48-982d-64ae2193b0a7 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:56.636892 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d126b8fa-1cc8-4c48-982d-64ae2193b0a7 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:56.643764 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d126b8fa-1cc8-4c48-982d-64ae2193b0a7 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:56.644293 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d126b8fa-1cc8-4c48-982d-64ae2193b0a7 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:56.645139 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d126b8fa-1cc8-4c48-982d-64ae2193b0a7 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:56.645681 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d126b8fa-1cc8-4c48-982d-64ae2193b0a7 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:56.782238 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d126b8fa-1cc8-4c48-982d-64ae2193b0a7 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:56.789805 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d126b8fa-1cc8-4c48-982d-64ae2193b0a7 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1314 microversion: 2.1 time: 0.158208 Jul 26 12:58:56.790508 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 463/938] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:56 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:57.814121 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-792c23d4-caf6-477a-99f8-cefc1ccc38f5 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:57.815776 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-792c23d4-caf6-477a-99f8-cefc1ccc38f5 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:57.822751 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-792c23d4-caf6-477a-99f8-cefc1ccc38f5 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:57.823206 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-792c23d4-caf6-477a-99f8-cefc1ccc38f5 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:57.824228 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-792c23d4-caf6-477a-99f8-cefc1ccc38f5 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:57.824671 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-792c23d4-caf6-477a-99f8-cefc1ccc38f5 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:57.900862 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-c0e7799f-c0ae-4ee5-ac26-72ec36f9a8c3 req-157e4e29-32ee-4da9-8a28-d7f1b3e1e8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e32990-d7a8-4da5-8bc6-37e1b217299f", "name": "network-vif-plugged", "status": "completed", "tag": "9dd6aecf-51d4-4555-8b77-cf1e5ab81185"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:58:57.923407 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-c0e7799f-c0ae-4ee5-ac26-72ec36f9a8c3 req-157e4e29-32ee-4da9-8a28-d7f1b3e1e8d2 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:57.923907 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-c0e7799f-c0ae-4ee5-ac26-72ec36f9a8c3 req-157e4e29-32ee-4da9-8a28-d7f1b3e1e8d2 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:57.937336 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-c0e7799f-c0ae-4ee5-ac26-72ec36f9a8c3 req-157e4e29-32ee-4da9-8a28-d7f1b3e1e8d2 service nova] Creating event network-vif-plugged:9dd6aecf-51d4-4555-8b77-cf1e5ab81185 for instance 83e32990-d7a8-4da5-8bc6-37e1b217299f on hv-cinder-85093 Jul 26 12:58:57.943373 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-c0e7799f-c0ae-4ee5-ac26-72ec36f9a8c3 req-157e4e29-32ee-4da9-8a28-d7f1b3e1e8d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047562 Jul 26 12:58:57.944336 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 464/939] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:58:57.979806 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-792c23d4-caf6-477a-99f8-cefc1ccc38f5 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:57.989231 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-792c23d4-caf6-477a-99f8-cefc1ccc38f5 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1314 microversion: 2.1 time: 0.180517 Jul 26 12:58:57.989916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 476/940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:57 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:58:59.007332 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:59.008228 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=6 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:58:59.012772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-88f86735-4203-4bbd-9ac1-303e45eaa4d4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:58:59.013543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-88f86735-4203-4bbd-9ac1-303e45eaa4d4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:58:59.020754 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-88f86735-4203-4bbd-9ac1-303e45eaa4d4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:59.021061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-88f86735-4203-4bbd-9ac1-303e45eaa4d4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:59.021946 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-88f86735-4203-4bbd-9ac1-303e45eaa4d4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:58:59.022244 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-88f86735-4203-4bbd-9ac1-303e45eaa4d4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:58:59.157135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-88f86735-4203-4bbd-9ac1-303e45eaa4d4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:58:59.168988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-88f86735-4203-4bbd-9ac1-303e45eaa4d4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1314 microversion: 2.1 time: 0.162807 Jul 26 12:58:59.169853 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 465/941] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:58:59 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:00.190241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-51b9a733-eec4-44b9-a95d-be0fd7dd4a81 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:00.191011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-51b9a733-eec4-44b9-a95d-be0fd7dd4a81 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:00.192999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=2 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:00.199623 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-51b9a733-eec4-44b9-a95d-be0fd7dd4a81 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:00.200043 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-51b9a733-eec4-44b9-a95d-be0fd7dd4a81 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:00.200823 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-51b9a733-eec4-44b9-a95d-be0fd7dd4a81 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:00.201258 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-51b9a733-eec4-44b9-a95d-be0fd7dd4a81 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:00.338776 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-51b9a733-eec4-44b9-a95d-be0fd7dd4a81 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:00.346239 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-51b9a733-eec4-44b9-a95d-be0fd7dd4a81 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1498 microversion: 2.1 time: 0.159796 Jul 26 12:59:00.346810 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 477/942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:00 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:00.783407 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ea77dd00-a3ef-4e06-84d1-188c1e15f864 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:00.784161 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ea77dd00-a3ef-4e06-84d1-188c1e15f864 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:00.791059 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ea77dd00-a3ef-4e06-84d1-188c1e15f864 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:00.791503 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ea77dd00-a3ef-4e06-84d1-188c1e15f864 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:00.792291 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ea77dd00-a3ef-4e06-84d1-188c1e15f864 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:00.792724 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ea77dd00-a3ef-4e06-84d1-188c1e15f864 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:00.818878 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ea77dd00-a3ef-4e06-84d1-188c1e15f864 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Going to try to terminate instance {{(pid=129308) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:59:00.898642 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ea77dd00-a3ef-4e06-84d1-188c1e15f864 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "DELETE /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 204 len: 0 microversion: 2.1 time: 0.118066 Jul 26 12:59:00.899510 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 466/943] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:59:00 2022] DELETE /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:59:00.909125 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-cce36ad0-8ef0-4c6a-9e8c-68ce775364a4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:00.909882 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-cce36ad0-8ef0-4c6a-9e8c-68ce775364a4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:00.916696 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cce36ad0-8ef0-4c6a-9e8c-68ce775364a4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:00.917151 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cce36ad0-8ef0-4c6a-9e8c-68ce775364a4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:00.917955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cce36ad0-8ef0-4c6a-9e8c-68ce775364a4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:00.918393 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cce36ad0-8ef0-4c6a-9e8c-68ce775364a4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:01.064751 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-cce36ad0-8ef0-4c6a-9e8c-68ce775364a4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:01.074751 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-cce36ad0-8ef0-4c6a-9e8c-68ce775364a4 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1504 microversion: 2.1 time: 0.170353 Jul 26 12:59:01.075506 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 478/944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:00 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:02.095352 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-502b3d45-1367-45ee-86ca-d4792d7766a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:02.096103 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-502b3d45-1367-45ee-86ca-d4792d7766a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:02.102485 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-502b3d45-1367-45ee-86ca-d4792d7766a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:02.102937 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-502b3d45-1367-45ee-86ca-d4792d7766a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:02.103746 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-502b3d45-1367-45ee-86ca-d4792d7766a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:02.104190 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-502b3d45-1367-45ee-86ca-d4792d7766a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:02.240815 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-502b3d45-1367-45ee-86ca-d4792d7766a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:02.248337 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-502b3d45-1367-45ee-86ca-d4792d7766a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1504 microversion: 2.1 time: 0.157043 Jul 26 12:59:02.248945 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 467/945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:02 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:02.853658 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-3483577c-b7af-4188-b543-0804158a8967 req-e8b8259e-3fd9-40c8-b228-5936fbfd11f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e32990-d7a8-4da5-8bc6-37e1b217299f", "name": "network-vif-deleted", "tag": "9dd6aecf-51d4-4555-8b77-cf1e5ab81185"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:59:02.863683 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-3483577c-b7af-4188-b543-0804158a8967 req-e8b8259e-3fd9-40c8-b228-5936fbfd11f9 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:02.864163 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-3483577c-b7af-4188-b543-0804158a8967 req-e8b8259e-3fd9-40c8-b228-5936fbfd11f9 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:02.875509 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-3483577c-b7af-4188-b543-0804158a8967 req-e8b8259e-3fd9-40c8-b228-5936fbfd11f9 service nova] Creating event network-vif-deleted:9dd6aecf-51d4-4555-8b77-cf1e5ab81185 for instance 83e32990-d7a8-4da5-8bc6-37e1b217299f on hv-cinder-85093 Jul 26 12:59:02.880618 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-3483577c-b7af-4188-b543-0804158a8967 req-e8b8259e-3fd9-40c8-b228-5936fbfd11f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030911 Jul 26 12:59:02.881208 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 479/946] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:59:03.276748 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7ecc8eee-8e21-4fe6-9911-db2f16d1a609 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:03.277376 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7ecc8eee-8e21-4fe6-9911-db2f16d1a609 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:03.283890 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ecc8eee-8e21-4fe6-9911-db2f16d1a609 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:03.284333 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ecc8eee-8e21-4fe6-9911-db2f16d1a609 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:03.285092 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ecc8eee-8e21-4fe6-9911-db2f16d1a609 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:03.285528 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ecc8eee-8e21-4fe6-9911-db2f16d1a609 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:03.317921 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ecc8eee-8e21-4fe6-9911-db2f16d1a609 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:03.318382 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7ecc8eee-8e21-4fe6-9911-db2f16d1a609 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:03.318833 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-7ecc8eee-8e21-4fe6-9911-db2f16d1a609 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lazy-loading 'fault' on Instance uuid 83e32990-d7a8-4da5-8bc6-37e1b217299f {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:59:03.363265 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7ecc8eee-8e21-4fe6-9911-db2f16d1a609 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:03.375712 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7ecc8eee-8e21-4fe6-9911-db2f16d1a609 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 200 len: 1304 microversion: 2.1 time: 0.102559 Jul 26 12:59:03.376769 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 468/947] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:03 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:04.398318 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-73b2203b-42af-4b11-9e69-819cb91f2224 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:04.400874 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-73b2203b-42af-4b11-9e69-819cb91f2224 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: 83e32990-d7a8-4da5-8bc6-37e1b217299f] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:04.406060 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-73b2203b-42af-4b11-9e69-819cb91f2224 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:04.406512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-73b2203b-42af-4b11-9e69-819cb91f2224 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:04.407282 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-73b2203b-42af-4b11-9e69-819cb91f2224 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:04.407741 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-73b2203b-42af-4b11-9e69-819cb91f2224 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:04.420937 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-73b2203b-42af-4b11-9e69-819cb91f2224 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] HTTP exception thrown: Instance 83e32990-d7a8-4da5-8bc6-37e1b217299f could not be found. Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-73b2203b-42af-4b11-9e69-819cb91f2224 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Request method failure captured: Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f HTTP/1.1 Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-UGq85mSWWjF6MErAcabNObE64r_cJDljLZngZ_QIXF96blX_S6ZKFR0LDpUbC1awZdwCp9elpINmBgaqjNKxq8FIYt2ubxuei2CxNItgJovh3gqCvNOJ_VuekTzdbrIonhyVp7dlR1sBJE-CGdrS4K8i_wZsJHs7KQO5fljMLqqMw Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: dc0f5db491bd494d943de6bf1084c1a5 Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-VolumesActionsTest-706482301 Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:59:04.422576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:59:04.424334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc0f5db491bd494d943de6bf1084c1a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc0f5db491bd494d943de6bf1084c1a5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc0f5db491bd494d943de6bf1084c1a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc0f5db491bd494d943de6bf1084c1a5"}]}] Jul 26 12:59:04.424334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-VolumesActionsTest-706482301 Jul 26 12:59:04.424334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: dc0f5db491bd494d943de6bf1084c1a5 Jul 26 12:59:04.424334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-VolumesActionsTest-706482301 Jul 26 12:59:04.424334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-VolumesActionsTest-706482301-project Jul 26 12:59:04.424334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:59:04.424334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:59:04.424334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 8e8b5c62a961409baaaa101f61437f1e Jul 26 12:59:04.424334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-VolumesActionsTest-706482301-project Jul 26 12:59:04.424334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:59:04.424334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 83e32990-d7a8-4da5-8bc6-37e1b217299f could not be found. Jul 26 12:59:04.424334 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '83e32990-d7a8-4da5-8bc6-37e1b217299f'} Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83e32990-d7a8-4da5-8bc6-37e1b217299f could not be found. Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:59:04.425578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83e32990-d7a8-4da5-8bc6-37e1b217299f could not be found. Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83e32990-d7a8-4da5-8bc6-37e1b217299f could not be found. Jul 26 12:59:04.427122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:04.428622 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-73b2203b-42af-4b11-9e69-819cb91f2224 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Returning 404 to user: Instance 83e32990-d7a8-4da5-8bc6-37e1b217299f could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:59:04.428622 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-73b2203b-42af-4b11-9e69-819cb91f2224 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f" status: 404 len: 111 microversion: 2.1 time: 0.030612 Jul 26 12:59:04.428622 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 480/948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:04 2022] GET /compute/v2.1/servers/83e32990-d7a8-4da5-8bc6-37e1b217299f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:59:04.521814 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-88430622", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "networks": [{"uuid": "c283aae5-6242-48a3-b842-d996f4419472"}]}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:59:04.574358 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.network.neutron [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] validate_networks() for [('c283aae5-6242-48a3-b842-d996f4419472', None, None, None, None, None)] {{(pid=129308) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 12:59:04.929370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Flavor limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 12:59:04.929823 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Image limits 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 12:59:04.930839 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Flavor pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 12:59:04.931246 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Image pref 0:0:0 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 12:59:04.931675 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.virt.hardware [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129308) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 12:59:04.940808 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:04.941271 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:04.942242 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:04.942676 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:04.959750 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Getting quotas for project dc0f5db491bd494d943de6bf1084c1a5. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 12:59:04.964007 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Getting quotas for user 8e8b5c62a961409baaaa101f61437f1e and project dc0f5db491bd494d943de6bf1084c1a5. Resources: {'ram', 'instances', 'cores'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 12:59:04.974901 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Going to run 1 instances... {{(pid=129308) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 12:59:04.977687 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129308) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 12:59:05.023908 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1b421da7-86d6-4485-b7a0-a4eadfb976a1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505857 Jul 26 12:59:05.027748 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 469/949] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 12:59:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 12:59:05.036122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-fd4809cb-b215-4555-96f1-b7158af0fed6 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:05.036929 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-fd4809cb-b215-4555-96f1-b7158af0fed6 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:05.039171 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:05.100181 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-fd4809cb-b215-4555-96f1-b7158af0fed6 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:05.107786 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-fd4809cb-b215-4555-96f1-b7158af0fed6 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 200 len: 1212 microversion: 2.1 time: 0.075581 Jul 26 12:59:05.108435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 481/950] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:05 2022] GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 1212 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:06.128436 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-30d87dd5-407a-4899-a67a-1fee8acad762 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:06.129333 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-30d87dd5-407a-4899-a67a-1fee8acad762 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:06.138546 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-30d87dd5-407a-4899-a67a-1fee8acad762 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:06.139124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-30d87dd5-407a-4899-a67a-1fee8acad762 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:06.140029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-30d87dd5-407a-4899-a67a-1fee8acad762 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:06.140533 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-30d87dd5-407a-4899-a67a-1fee8acad762 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:06.247463 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-30d87dd5-407a-4899-a67a-1fee8acad762 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:06.255235 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-30d87dd5-407a-4899-a67a-1fee8acad762 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 200 len: 1282 microversion: 2.1 time: 0.130687 Jul 26 12:59:06.255847 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 470/951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:06 2022] GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 1282 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:07.280647 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-55fe893e-085b-47cc-9380-981937d20126 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:07.281803 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-55fe893e-085b-47cc-9380-981937d20126 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:07.288999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-55fe893e-085b-47cc-9380-981937d20126 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:07.290237 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-55fe893e-085b-47cc-9380-981937d20126 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:07.290710 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-55fe893e-085b-47cc-9380-981937d20126 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:07.291286 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-55fe893e-085b-47cc-9380-981937d20126 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:07.416377 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-238a3fa8-4c4d-475b-a0d9-67ddb7d1e775 req-f8a845e0-5357-4eec-908b-7f42eb30a45d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4c1efda-fc6f-478d-8c7e-d227e99bdc90", "tag": "ac1e938b-a7e5-4d6f-847f-458a567d7d23"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:59:07.426995 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-238a3fa8-4c4d-475b-a0d9-67ddb7d1e775 req-f8a845e0-5357-4eec-908b-7f42eb30a45d service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:07.427895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-238a3fa8-4c4d-475b-a0d9-67ddb7d1e775 req-f8a845e0-5357-4eec-908b-7f42eb30a45d service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:07.450095 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-238a3fa8-4c4d-475b-a0d9-67ddb7d1e775 req-f8a845e0-5357-4eec-908b-7f42eb30a45d service nova] Creating event network-changed:ac1e938b-a7e5-4d6f-847f-458a567d7d23 for instance a4c1efda-fc6f-478d-8c7e-d227e99bdc90 on hv-cinder-85093 Jul 26 12:59:07.452022 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-55fe893e-085b-47cc-9380-981937d20126 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:07.455964 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-238a3fa8-4c4d-475b-a0d9-67ddb7d1e775 req-f8a845e0-5357-4eec-908b-7f42eb30a45d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043618 Jul 26 12:59:07.456768 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 471/952] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 12:59:07.461088 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-55fe893e-085b-47cc-9380-981937d20126 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 200 len: 1312 microversion: 2.1 time: 0.186679 Jul 26 12:59:07.461703 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 482/953] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:07 2022] GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:08.483792 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b53e3a8a-dab0-4b87-8038-e9d358e832d0 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:08.485159 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b53e3a8a-dab0-4b87-8038-e9d358e832d0 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:08.496048 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b53e3a8a-dab0-4b87-8038-e9d358e832d0 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:08.496850 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b53e3a8a-dab0-4b87-8038-e9d358e832d0 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:08.497763 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b53e3a8a-dab0-4b87-8038-e9d358e832d0 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:08.498344 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b53e3a8a-dab0-4b87-8038-e9d358e832d0 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:08.693903 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-b53e3a8a-dab0-4b87-8038-e9d358e832d0 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:08.705513 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b53e3a8a-dab0-4b87-8038-e9d358e832d0 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 200 len: 1312 microversion: 2.1 time: 0.227046 Jul 26 12:59:08.706250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 472/954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:08 2022] GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 1312 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:09.748781 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-a35ac06b-ab6e-4263-9d85-19524e402a3c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:09.749481 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-a35ac06b-ab6e-4263-9d85-19524e402a3c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:09.757346 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a35ac06b-ab6e-4263-9d85-19524e402a3c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:09.757801 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a35ac06b-ab6e-4263-9d85-19524e402a3c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:09.758598 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a35ac06b-ab6e-4263-9d85-19524e402a3c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:09.759181 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a35ac06b-ab6e-4263-9d85-19524e402a3c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:09.928517 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-a35ac06b-ab6e-4263-9d85-19524e402a3c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:09.941560 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-a35ac06b-ab6e-4263-9d85-19524e402a3c tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 200 len: 1312 microversion: 2.1 time: 0.196434 Jul 26 12:59:09.942175 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 483/955] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:09 2022] GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:10.963330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8a895d84-cf2f-4f5d-8d28-0b601ffca6ef tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:10.963995 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8a895d84-cf2f-4f5d-8d28-0b601ffca6ef tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:10.972432 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8a895d84-cf2f-4f5d-8d28-0b601ffca6ef tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:10.972886 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8a895d84-cf2f-4f5d-8d28-0b601ffca6ef tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:10.973677 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8a895d84-cf2f-4f5d-8d28-0b601ffca6ef tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:10.974179 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8a895d84-cf2f-4f5d-8d28-0b601ffca6ef tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:11.118804 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8a895d84-cf2f-4f5d-8d28-0b601ffca6ef tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:11.126301 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8a895d84-cf2f-4f5d-8d28-0b601ffca6ef tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 200 len: 1312 microversion: 2.1 time: 0.167602 Jul 26 12:59:11.126870 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 473/956] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:10 2022] GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:11.944304 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-2bf31dc1-7032-4571-ad2d-a16614eff590 req-83fb0fc9-3bc0-45f9-9ca8-245c595259d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c1efda-fc6f-478d-8c7e-d227e99bdc90", "name": "network-vif-plugged", "status": "completed", "tag": "ac1e938b-a7e5-4d6f-847f-458a567d7d23"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:59:11.957562 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-2bf31dc1-7032-4571-ad2d-a16614eff590 req-83fb0fc9-3bc0-45f9-9ca8-245c595259d8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:11.958156 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-2bf31dc1-7032-4571-ad2d-a16614eff590 req-83fb0fc9-3bc0-45f9-9ca8-245c595259d8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:11.962193 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=65 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:11.971319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-2bf31dc1-7032-4571-ad2d-a16614eff590 req-83fb0fc9-3bc0-45f9-9ca8-245c595259d8 service nova] Creating event network-vif-plugged:ac1e938b-a7e5-4d6f-847f-458a567d7d23 for instance a4c1efda-fc6f-478d-8c7e-d227e99bdc90 on hv-cinder-85093 Jul 26 12:59:11.976752 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-2bf31dc1-7032-4571-ad2d-a16614eff590 req-83fb0fc9-3bc0-45f9-9ca8-245c595259d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036361 Jul 26 12:59:11.977851 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 484/957] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:59:12.150662 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-85e5e364-ea34-4c2d-abe4-e00bbf332d4a tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:12.151932 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-85e5e364-ea34-4c2d-abe4-e00bbf332d4a tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:12.159905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-85e5e364-ea34-4c2d-abe4-e00bbf332d4a tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:12.160346 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-85e5e364-ea34-4c2d-abe4-e00bbf332d4a tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:12.161484 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-85e5e364-ea34-4c2d-abe4-e00bbf332d4a tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:12.161928 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-85e5e364-ea34-4c2d-abe4-e00bbf332d4a tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:12.311315 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-85e5e364-ea34-4c2d-abe4-e00bbf332d4a tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:12.318727 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-85e5e364-ea34-4c2d-abe4-e00bbf332d4a tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 200 len: 1312 microversion: 2.1 time: 0.172733 Jul 26 12:59:12.319504 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 474/958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:12 2022] GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:59:13.305585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-a8f42ab6-f26d-4329-bd3c-2f57ffa6148e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:13.306331 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-a8f42ab6-f26d-4329-bd3c-2f57ffa6148e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:13.313914 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a8f42ab6-f26d-4329-bd3c-2f57ffa6148e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:13.314470 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a8f42ab6-f26d-4329-bd3c-2f57ffa6148e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:13.315308 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a8f42ab6-f26d-4329-bd3c-2f57ffa6148e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:13.315784 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-a8f42ab6-f26d-4329-bd3c-2f57ffa6148e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:13.340132 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ebd043c2-2dbd-4805-bdf2-e61795069aa9 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:13.340870 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ebd043c2-2dbd-4805-bdf2-e61795069aa9 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:13.347447 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ebd043c2-2dbd-4805-bdf2-e61795069aa9 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:13.347838 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ebd043c2-2dbd-4805-bdf2-e61795069aa9 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:13.348622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ebd043c2-2dbd-4805-bdf2-e61795069aa9 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:13.349067 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ebd043c2-2dbd-4805-bdf2-e61795069aa9 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:13.405688 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-a8f42ab6-f26d-4329-bd3c-2f57ffa6148e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lazy-loading 'services' on Instance uuid 5a1a3713-8bde-42c4-ad34-76974193ab34 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:59:13.483194 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-a8f42ab6-f26d-4329-bd3c-2f57ffa6148e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/os-volume_attachments/b85e7ce7-dab9-48b3-948c-4746acba17e6" status: 202 len: 0 microversion: 2.1 time: 0.182327 Jul 26 12:59:13.483792 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 485/959] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Jul 26 12:59:13 2022] DELETE /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/os-volume_attachments/b85e7ce7-dab9-48b3-948c-4746acba17e6 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:59:13.498234 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ebd043c2-2dbd-4805-bdf2-e61795069aa9 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:13.506257 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ebd043c2-2dbd-4805-bdf2-e61795069aa9 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 200 len: 1312 microversion: 2.1 time: 0.170661 Jul 26 12:59:13.507506 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 475/960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:13 2022] GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:14.532850 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-cc39450e-858d-4e8c-80d6-e61aa64597f1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:14.535195 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-cc39450e-858d-4e8c-80d6-e61aa64597f1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:14.543323 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cc39450e-858d-4e8c-80d6-e61aa64597f1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:14.543817 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cc39450e-858d-4e8c-80d6-e61aa64597f1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:14.544619 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cc39450e-858d-4e8c-80d6-e61aa64597f1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:14.545090 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cc39450e-858d-4e8c-80d6-e61aa64597f1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:14.642831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c7863815-f12a-4366-a937-aa568cd874f6 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:59:14.650243 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c7863815-f12a-4366-a937-aa568cd874f6 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:14.650689 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c7863815-f12a-4366-a937-aa568cd874f6 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:14.681849 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c7863815-f12a-4366-a937-aa568cd874f6 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Going to try to stop instance {{(pid=129308) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 12:59:14.729467 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:14.743276 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c7863815-f12a-4366-a937-aa568cd874f6 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "POST /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/action" status: 202 len: 0 microversion: 2.1 time: 0.104499 Jul 26 12:59:14.744846 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 476/961] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 12:59:14 2022] POST /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:59:14.751455 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-cc39450e-858d-4e8c-80d6-e61aa64597f1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:14.754360 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-116d7d61-005d-4ba6-ae82-3c641acea2b8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:14.755074 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-116d7d61-005d-4ba6-ae82-3c641acea2b8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:14.763045 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-cc39450e-858d-4e8c-80d6-e61aa64597f1 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 200 len: 1496 microversion: 2.1 time: 0.236653 Jul 26 12:59:14.764158 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 486/962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:14 2022] GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 1496 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:14.764326 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-116d7d61-005d-4ba6-ae82-3c641acea2b8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:14.764841 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-116d7d61-005d-4ba6-ae82-3c641acea2b8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:14.765898 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-116d7d61-005d-4ba6-ae82-3c641acea2b8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:14.766437 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-116d7d61-005d-4ba6-ae82-3c641acea2b8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:14.933210 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-116d7d61-005d-4ba6-ae82-3c641acea2b8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:14.943966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-116d7d61-005d-4ba6-ae82-3c641acea2b8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1676 microversion: 2.1 time: 0.193783 Jul 26 12:59:14.944949 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 477/963] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:14 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:59:15.289427 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f9c00391-dfda-4cfc-90f8-f30866cbc891 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:15.290054 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f9c00391-dfda-4cfc-90f8-f30866cbc891 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:15.293098 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=2 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:15.297300 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f9c00391-dfda-4cfc-90f8-f30866cbc891 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:15.297756 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f9c00391-dfda-4cfc-90f8-f30866cbc891 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:15.298539 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f9c00391-dfda-4cfc-90f8-f30866cbc891 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:15.298977 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f9c00391-dfda-4cfc-90f8-f30866cbc891 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:15.324774 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f9c00391-dfda-4cfc-90f8-f30866cbc891 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Going to try to terminate instance {{(pid=129307) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:59:15.416250 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f9c00391-dfda-4cfc-90f8-f30866cbc891 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 204 len: 0 microversion: 2.1 time: 0.125646 Jul 26 12:59:15.420243 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 487/964] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:59:15 2022] DELETE /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 12:59:15.428582 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e91fa0fb-2170-4d57-a766-4b47d74ba64d tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:15.429491 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e91fa0fb-2170-4d57-a766-4b47d74ba64d tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:15.433147 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:15.433850 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=6 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:15.439044 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e91fa0fb-2170-4d57-a766-4b47d74ba64d tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:15.439505 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e91fa0fb-2170-4d57-a766-4b47d74ba64d tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:15.440318 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e91fa0fb-2170-4d57-a766-4b47d74ba64d tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:15.440762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e91fa0fb-2170-4d57-a766-4b47d74ba64d tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:15.597323 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e91fa0fb-2170-4d57-a766-4b47d74ba64d tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:15.605153 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e91fa0fb-2170-4d57-a766-4b47d74ba64d tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 200 len: 1502 microversion: 2.1 time: 0.183569 Jul 26 12:59:15.605731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 478/965] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:15 2022] GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:15.969520 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-95aad885-740c-417c-b184-ee9a4f748403 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:15.970383 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-95aad885-740c-417c-b184-ee9a4f748403 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:15.977147 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-95aad885-740c-417c-b184-ee9a4f748403 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:15.977605 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-95aad885-740c-417c-b184-ee9a4f748403 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:15.978395 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-95aad885-740c-417c-b184-ee9a4f748403 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:15.978839 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-95aad885-740c-417c-b184-ee9a4f748403 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:16.139901 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-95aad885-740c-417c-b184-ee9a4f748403 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:16.147395 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-95aad885-740c-417c-b184-ee9a4f748403 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1676 microversion: 2.1 time: 0.182255 Jul 26 12:59:16.147996 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 488/966] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:15 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:16.629229 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-52c65b18-a260-4dd3-8f04-7735702e2a61 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:16.630318 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-52c65b18-a260-4dd3-8f04-7735702e2a61 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:16.643917 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-52c65b18-a260-4dd3-8f04-7735702e2a61 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:16.644374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-52c65b18-a260-4dd3-8f04-7735702e2a61 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:16.645416 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-52c65b18-a260-4dd3-8f04-7735702e2a61 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:16.645904 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-52c65b18-a260-4dd3-8f04-7735702e2a61 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:16.794689 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-52c65b18-a260-4dd3-8f04-7735702e2a61 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:16.802980 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-52c65b18-a260-4dd3-8f04-7735702e2a61 tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 200 len: 1502 microversion: 2.1 time: 0.179690 Jul 26 12:59:16.803600 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 479/967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:16 2022] GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:17.171042 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-10d5a257-d795-42e1-ac9a-aa9f6ac83188 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:17.171671 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-10d5a257-d795-42e1-ac9a-aa9f6ac83188 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:17.188977 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10d5a257-d795-42e1-ac9a-aa9f6ac83188 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:17.189453 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10d5a257-d795-42e1-ac9a-aa9f6ac83188 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:17.190268 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10d5a257-d795-42e1-ac9a-aa9f6ac83188 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:17.190682 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10d5a257-d795-42e1-ac9a-aa9f6ac83188 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:17.371987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-10d5a257-d795-42e1-ac9a-aa9f6ac83188 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:17.383493 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-10d5a257-d795-42e1-ac9a-aa9f6ac83188 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1676 microversion: 2.1 time: 0.215981 Jul 26 12:59:17.384338 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 489/968] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:17 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1676 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:17.466067 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-21771d67-bca8-4663-b642-9ff1ed56c4f1 req-25123d84-b459-47d7-968f-af06d94b63b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4c1efda-fc6f-478d-8c7e-d227e99bdc90", "name": "network-vif-deleted", "tag": "ac1e938b-a7e5-4d6f-847f-458a567d7d23"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:59:17.476904 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-21771d67-bca8-4663-b642-9ff1ed56c4f1 req-25123d84-b459-47d7-968f-af06d94b63b3 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:17.477914 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-21771d67-bca8-4663-b642-9ff1ed56c4f1 req-25123d84-b459-47d7-968f-af06d94b63b3 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:17.488989 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-21771d67-bca8-4663-b642-9ff1ed56c4f1 req-25123d84-b459-47d7-968f-af06d94b63b3 service nova] Creating event network-vif-deleted:ac1e938b-a7e5-4d6f-847f-458a567d7d23 for instance a4c1efda-fc6f-478d-8c7e-d227e99bdc90 on hv-cinder-85093 Jul 26 12:59:17.494587 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-21771d67-bca8-4663-b642-9ff1ed56c4f1 req-25123d84-b459-47d7-968f-af06d94b63b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031943 Jul 26 12:59:17.495319 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 480/969] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:59:17.829800 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9d1f3b6a-95ee-4783-a7fb-711f5b58022e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:17.830424 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-9d1f3b6a-95ee-4783-a7fb-711f5b58022e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:17.837085 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9d1f3b6a-95ee-4783-a7fb-711f5b58022e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:17.837549 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9d1f3b6a-95ee-4783-a7fb-711f5b58022e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:17.838319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9d1f3b6a-95ee-4783-a7fb-711f5b58022e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:17.838763 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9d1f3b6a-95ee-4783-a7fb-711f5b58022e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:17.872913 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9d1f3b6a-95ee-4783-a7fb-711f5b58022e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:17.873432 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-9d1f3b6a-95ee-4783-a7fb-711f5b58022e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:17.873978 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-9d1f3b6a-95ee-4783-a7fb-711f5b58022e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lazy-loading 'fault' on Instance uuid a4c1efda-fc6f-478d-8c7e-d227e99bdc90 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:59:17.924603 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-9d1f3b6a-95ee-4783-a7fb-711f5b58022e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e8b5c62a961409baaaa101f61437f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc0f5db491bd494d943de6bf1084c1a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:17.933122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9d1f3b6a-95ee-4783-a7fb-711f5b58022e tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 200 len: 1302 microversion: 2.1 time: 0.107156 Jul 26 12:59:17.946917 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 490/970] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:17 2022] GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 1302 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:18.409117 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-26855112-3e43-4fbb-95c3-899689bc1ed8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:18.409898 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-26855112-3e43-4fbb-95c3-899689bc1ed8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:18.412064 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:18.417883 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-26855112-3e43-4fbb-95c3-899689bc1ed8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:18.418329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-26855112-3e43-4fbb-95c3-899689bc1ed8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:18.419087 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-26855112-3e43-4fbb-95c3-899689bc1ed8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:18.419517 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-26855112-3e43-4fbb-95c3-899689bc1ed8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:18.564583 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-26855112-3e43-4fbb-95c3-899689bc1ed8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:18.573459 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-26855112-3e43-4fbb-95c3-899689bc1ed8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1676 microversion: 2.1 time: 0.168885 Jul 26 12:59:18.574460 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 481/971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:18 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:18.954517 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-58684661-8771-43ef-a47d-801e2bd9b21f tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:18.955075 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-58684661-8771-43ef-a47d-801e2bd9b21f tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] [instance: a4c1efda-fc6f-478d-8c7e-d227e99bdc90] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:18.961594 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-58684661-8771-43ef-a47d-801e2bd9b21f tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:18.962045 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-58684661-8771-43ef-a47d-801e2bd9b21f tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:18.962805 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-58684661-8771-43ef-a47d-801e2bd9b21f tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:18.963244 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-58684661-8771-43ef-a47d-801e2bd9b21f tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:18.976684 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-58684661-8771-43ef-a47d-801e2bd9b21f tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] HTTP exception thrown: Instance a4c1efda-fc6f-478d-8c7e-d227e99bdc90 could not be found. Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-58684661-8771-43ef-a47d-801e2bd9b21f tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Request method failure captured: Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 HTTP/1.1 Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-UGq85mSWWjF6MErAcabNObE64r_cJDljLZngZ_QIXF96blX_S6ZKFR0LDpUbC1awZdwCp9elpINmBgaqjNKxq8FIYt2ubxuei2CxNItgJovh3gqCvNOJ_VuekTzdbrIonhyVp7dlR1sBJE-CGdrS4K8i_wZsJHs7KQO5fljMLqqMw Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: dc0f5db491bd494d943de6bf1084c1a5 Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-VolumesActionsTest-706482301 Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:59:18.978297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:59:18.979836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dc0f5db491bd494d943de6bf1084c1a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dc0f5db491bd494d943de6bf1084c1a5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc0f5db491bd494d943de6bf1084c1a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dc0f5db491bd494d943de6bf1084c1a5"}]}] Jul 26 12:59:18.979836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-VolumesActionsTest-706482301 Jul 26 12:59:18.979836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: dc0f5db491bd494d943de6bf1084c1a5 Jul 26 12:59:18.979836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-VolumesActionsTest-706482301 Jul 26 12:59:18.979836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-VolumesActionsTest-706482301-project Jul 26 12:59:18.979836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:59:18.979836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:59:18.979836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: 8e8b5c62a961409baaaa101f61437f1e Jul 26 12:59:18.979836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-VolumesActionsTest-706482301-project Jul 26 12:59:18.979836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:59:18.979836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance a4c1efda-fc6f-478d-8c7e-d227e99bdc90 could not be found. Jul 26 12:59:18.979836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': 'a4c1efda-fc6f-478d-8c7e-d227e99bdc90'} Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4c1efda-fc6f-478d-8c7e-d227e99bdc90 could not be found. Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:59:18.980725 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4c1efda-fc6f-478d-8c7e-d227e99bdc90 could not be found. Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4c1efda-fc6f-478d-8c7e-d227e99bdc90 could not be found. Jul 26 12:59:18.982116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:18.983333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-58684661-8771-43ef-a47d-801e2bd9b21f tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] Returning 404 to user: Instance a4c1efda-fc6f-478d-8c7e-d227e99bdc90 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:59:18.983333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-58684661-8771-43ef-a47d-801e2bd9b21f tempest-VolumesActionsTest-706482301 tempest-VolumesActionsTest-706482301-project] 10.222.0.20 "GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90" status: 404 len: 111 microversion: 2.1 time: 0.029139 Jul 26 12:59:18.983333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 491/972] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:18 2022] GET /compute/v2.1/servers/a4c1efda-fc6f-478d-8c7e-d227e99bdc90 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:59:19.596864 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-537d7b0a-7bb3-4086-9da5-50e628493242 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:19.597550 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-537d7b0a-7bb3-4086-9da5-50e628493242 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:19.604496 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-537d7b0a-7bb3-4086-9da5-50e628493242 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:19.604955 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-537d7b0a-7bb3-4086-9da5-50e628493242 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:19.605731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-537d7b0a-7bb3-4086-9da5-50e628493242 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:19.606175 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-537d7b0a-7bb3-4086-9da5-50e628493242 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:19.771709 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-537d7b0a-7bb3-4086-9da5-50e628493242 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:19.778544 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-537d7b0a-7bb3-4086-9da5-50e628493242 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1676 microversion: 2.1 time: 0.185532 Jul 26 12:59:19.779274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 482/973] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:19 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:20.801056 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-20d82a41-275b-460b-95a0-2344a0f20fcc tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:20.801657 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-20d82a41-275b-460b-95a0-2344a0f20fcc tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:20.808836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20d82a41-275b-460b-95a0-2344a0f20fcc tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:20.809290 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20d82a41-275b-460b-95a0-2344a0f20fcc tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:20.810075 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20d82a41-275b-460b-95a0-2344a0f20fcc tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:20.810520 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-20d82a41-275b-460b-95a0-2344a0f20fcc tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:20.962113 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-20d82a41-275b-460b-95a0-2344a0f20fcc tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:20.970055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-20d82a41-275b-460b-95a0-2344a0f20fcc tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1676 microversion: 2.1 time: 0.172807 Jul 26 12:59:20.970666 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 492/974] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:20 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:21.991796 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d95104a9-e0b4-445c-8b35-7b35690cfea9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:21.992413 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d95104a9-e0b4-445c-8b35-7b35690cfea9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:21.999859 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d95104a9-e0b4-445c-8b35-7b35690cfea9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:22.000344 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d95104a9-e0b4-445c-8b35-7b35690cfea9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:22.001116 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d95104a9-e0b4-445c-8b35-7b35690cfea9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:22.001559 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d95104a9-e0b4-445c-8b35-7b35690cfea9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:22.133444 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d95104a9-e0b4-445c-8b35-7b35690cfea9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:22.140936 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d95104a9-e0b4-445c-8b35-7b35690cfea9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1676 microversion: 2.1 time: 0.153098 Jul 26 12:59:22.141508 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 483/975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:21 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:23.162267 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-bceae702-31bc-4393-9556-bbb282570e13 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:23.162896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-bceae702-31bc-4393-9556-bbb282570e13 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:23.169627 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bceae702-31bc-4393-9556-bbb282570e13 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:23.170073 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bceae702-31bc-4393-9556-bbb282570e13 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:23.170844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bceae702-31bc-4393-9556-bbb282570e13 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:23.171272 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bceae702-31bc-4393-9556-bbb282570e13 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:23.341238 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bceae702-31bc-4393-9556-bbb282570e13 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:23.348638 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-bceae702-31bc-4393-9556-bbb282570e13 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1676 microversion: 2.1 time: 0.190332 Jul 26 12:59:23.349208 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 493/976] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:23 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:24.375317 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-4becb400-1f0d-4f4f-856d-2c55e3ca997f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:24.376141 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-4becb400-1f0d-4f4f-856d-2c55e3ca997f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:24.386084 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4becb400-1f0d-4f4f-856d-2c55e3ca997f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:24.387047 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4becb400-1f0d-4f4f-856d-2c55e3ca997f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:24.388205 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4becb400-1f0d-4f4f-856d-2c55e3ca997f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:24.388953 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4becb400-1f0d-4f4f-856d-2c55e3ca997f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:24.867294 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-4becb400-1f0d-4f4f-856d-2c55e3ca997f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:24.875109 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-4becb400-1f0d-4f4f-856d-2c55e3ca997f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1676 microversion: 2.1 time: 0.508127 Jul 26 12:59:24.879058 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 484/977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:24 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1676 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:25.909824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6188c318-8400-481b-84f9-0b8fac0ecc74 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:25.910976 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-6188c318-8400-481b-84f9-0b8fac0ecc74 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:25.920166 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6188c318-8400-481b-84f9-0b8fac0ecc74 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:25.920847 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6188c318-8400-481b-84f9-0b8fac0ecc74 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:25.922146 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6188c318-8400-481b-84f9-0b8fac0ecc74 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:25.922839 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-6188c318-8400-481b-84f9-0b8fac0ecc74 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:26.118667 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-6188c318-8400-481b-84f9-0b8fac0ecc74 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:26.130440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-6188c318-8400-481b-84f9-0b8fac0ecc74 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1653 microversion: 2.1 time: 0.231757 Jul 26 12:59:26.131558 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 494/978] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:25 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1653 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:26.153825 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-bfad39d3-7df7-4575-92e4-611b334c8106 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:59:26.166234 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bfad39d3-7df7-4575-92e4-611b334c8106 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:26.166782 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-bfad39d3-7df7-4575-92e4-611b334c8106 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:26.206180 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-bfad39d3-7df7-4575-92e4-611b334c8106 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Going to try to start instance {{(pid=129308) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 12:59:26.274310 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-bfad39d3-7df7-4575-92e4-611b334c8106 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "POST /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/action" status: 202 len: 0 microversion: 2.1 time: 0.124103 Jul 26 12:59:26.276625 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 485/979] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 12:59:26 2022] POST /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 12:59:26.284643 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e05f7328-64a0-4c7a-a07b-8be73f5b9c1e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:26.285550 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e05f7328-64a0-4c7a-a07b-8be73f5b9c1e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:26.293973 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e05f7328-64a0-4c7a-a07b-8be73f5b9c1e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:26.294711 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e05f7328-64a0-4c7a-a07b-8be73f5b9c1e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:26.295793 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e05f7328-64a0-4c7a-a07b-8be73f5b9c1e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:26.296467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e05f7328-64a0-4c7a-a07b-8be73f5b9c1e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:26.502440 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e05f7328-64a0-4c7a-a07b-8be73f5b9c1e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:26.511522 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e05f7328-64a0-4c7a-a07b-8be73f5b9c1e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1662 microversion: 2.1 time: 0.230631 Jul 26 12:59:26.529401 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 495/980] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:26 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1662 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:27.540627 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-2d08c321-3c87-4bfe-8132-fcdbb4f706a9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:27.544706 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-2d08c321-3c87-4bfe-8132-fcdbb4f706a9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:27.553280 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2d08c321-3c87-4bfe-8132-fcdbb4f706a9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:27.553999 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2d08c321-3c87-4bfe-8132-fcdbb4f706a9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:27.555565 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2d08c321-3c87-4bfe-8132-fcdbb4f706a9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:27.556427 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2d08c321-3c87-4bfe-8132-fcdbb4f706a9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:27.803177 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2d08c321-3c87-4bfe-8132-fcdbb4f706a9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:27.819459 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-2d08c321-3c87-4bfe-8132-fcdbb4f706a9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1662 microversion: 2.1 time: 0.285663 Jul 26 12:59:27.821535 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 486/981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:27 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1662 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:28.844610 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-90c71bce-5eaa-4a32-ba05-ca1e81cd49ee tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:28.845519 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-90c71bce-5eaa-4a32-ba05-ca1e81cd49ee tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:28.854985 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-90c71bce-5eaa-4a32-ba05-ca1e81cd49ee tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:28.855835 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-90c71bce-5eaa-4a32-ba05-ca1e81cd49ee tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:28.856848 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-90c71bce-5eaa-4a32-ba05-ca1e81cd49ee tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:28.857367 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-90c71bce-5eaa-4a32-ba05-ca1e81cd49ee tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:29.016007 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-90c71bce-5eaa-4a32-ba05-ca1e81cd49ee tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:29.022666 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-90c71bce-5eaa-4a32-ba05-ca1e81cd49ee tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1666 microversion: 2.1 time: 0.181891 Jul 26 12:59:29.025705 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 496/982] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:28 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1666 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:48.320743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 12:59:48.321398 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Tue Jul 26 12:59:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 12:59:49.350384 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-94026d5c-7829-4a65-bbbd-42b1427365c5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:49.350955 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-94026d5c-7829-4a65-bbbd-42b1427365c5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:49.353380 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=11 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:49.354097 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=60,nova_cell1:UPDATE=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:49.355973 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-29d6153b-67b1-4500-9edd-01d5c7f46f4d req-9b91a972-b2e5-4786-8185-ea836524a290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1331709-485e-470a-9dcb-0b8832524597", "tag": "b9c4967a-1f5b-4bc9-9c07-7d4a8cc5768f"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:59:49.360897 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-94026d5c-7829-4a65-bbbd-42b1427365c5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:49.361373 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:49.361499 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-94026d5c-7829-4a65-bbbd-42b1427365c5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:49.362207 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 12:59:49.362389 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-94026d5c-7829-4a65-bbbd-42b1427365c5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:49.362941 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-94026d5c-7829-4a65-bbbd-42b1427365c5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:49.371387 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-29d6153b-67b1-4500-9edd-01d5c7f46f4d req-9b91a972-b2e5-4786-8185-ea836524a290 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:49.371903 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-29d6153b-67b1-4500-9edd-01d5c7f46f4d req-9b91a972-b2e5-4786-8185-ea836524a290 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:49.386962 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-29d6153b-67b1-4500-9edd-01d5c7f46f4d req-9b91a972-b2e5-4786-8185-ea836524a290 service nova] Creating event network-changed:b9c4967a-1f5b-4bc9-9c07-7d4a8cc5768f for instance f1331709-485e-470a-9dcb-0b8832524597 on hv-cinder-85093 Jul 26 12:59:49.392596 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-29d6153b-67b1-4500-9edd-01d5c7f46f4d req-9b91a972-b2e5-4786-8185-ea836524a290 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040286 Jul 26 12:59:49.393523 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 497/983] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:59:49.396570 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-94026d5c-7829-4a65-bbbd-42b1427365c5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Going to try to terminate instance {{(pid=129308) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 12:59:49.478599 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-94026d5c-7829-4a65-bbbd-42b1427365c5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 204 len: 0 microversion: 2.1 time: 0.131497 Jul 26 12:59:49.479391 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 487/984] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 12:59:49 2022] DELETE /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 12:59:49.488992 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-eece7266-bb3f-4890-abac-0e23339b613d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:49.489692 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-eece7266-bb3f-4890-abac-0e23339b613d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:49.496806 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eece7266-bb3f-4890-abac-0e23339b613d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:49.497277 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eece7266-bb3f-4890-abac-0e23339b613d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:49.498039 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eece7266-bb3f-4890-abac-0e23339b613d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:49.498475 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eece7266-bb3f-4890-abac-0e23339b613d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:49.642914 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-eece7266-bb3f-4890-abac-0e23339b613d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:49.650565 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-eece7266-bb3f-4890-abac-0e23339b613d tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.165861 Jul 26 12:59:49.651155 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 498/985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:49 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:50.672618 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ed13a082-8c58-4852-8aee-b84d5c3ad8b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:50.673230 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ed13a082-8c58-4852-8aee-b84d5c3ad8b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:50.679658 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed13a082-8c58-4852-8aee-b84d5c3ad8b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:50.680129 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed13a082-8c58-4852-8aee-b84d5c3ad8b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:50.680904 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed13a082-8c58-4852-8aee-b84d5c3ad8b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:50.681343 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed13a082-8c58-4852-8aee-b84d5c3ad8b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:50.812792 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ed13a082-8c58-4852-8aee-b84d5c3ad8b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:50.820483 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ed13a082-8c58-4852-8aee-b84d5c3ad8b1 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.152307 Jul 26 12:59:50.821059 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 488/986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:50 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:51.843297 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4a03f5b6-4788-4db0-9148-86d5155560a5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:51.843945 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4a03f5b6-4788-4db0-9148-86d5155560a5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:51.850905 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4a03f5b6-4788-4db0-9148-86d5155560a5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:51.851363 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4a03f5b6-4788-4db0-9148-86d5155560a5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:51.852174 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4a03f5b6-4788-4db0-9148-86d5155560a5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:51.852612 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4a03f5b6-4788-4db0-9148-86d5155560a5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:52.012773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4a03f5b6-4788-4db0-9148-86d5155560a5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:52.020710 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4a03f5b6-4788-4db0-9148-86d5155560a5 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.181781 Jul 26 12:59:52.023683 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 499/987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:51 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:53.042311 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-71f69fa1-51b0-4da2-a8d7-949884ce5a5a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:53.043546 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-71f69fa1-51b0-4da2-a8d7-949884ce5a5a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:53.050636 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-71f69fa1-51b0-4da2-a8d7-949884ce5a5a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:53.051079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-71f69fa1-51b0-4da2-a8d7-949884ce5a5a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:53.051938 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-71f69fa1-51b0-4da2-a8d7-949884ce5a5a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:53.052401 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-71f69fa1-51b0-4da2-a8d7-949884ce5a5a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:53.186157 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-71f69fa1-51b0-4da2-a8d7-949884ce5a5a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:53.193882 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-71f69fa1-51b0-4da2-a8d7-949884ce5a5a tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.155388 Jul 26 12:59:53.194656 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 489/988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:53 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 12:59:54.215241 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5b24014a-8639-48ba-9b5c-572e0abc103f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:54.215906 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5b24014a-8639-48ba-9b5c-572e0abc103f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:54.222390 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5b24014a-8639-48ba-9b5c-572e0abc103f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:54.222843 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5b24014a-8639-48ba-9b5c-572e0abc103f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:54.223602 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5b24014a-8639-48ba-9b5c-572e0abc103f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:54.224062 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5b24014a-8639-48ba-9b5c-572e0abc103f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:54.352772 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5b24014a-8639-48ba-9b5c-572e0abc103f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:54.360737 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5b24014a-8639-48ba-9b5c-572e0abc103f tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.149321 Jul 26 12:59:54.361305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 500/989] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:54 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:55.382174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-4141fd44-2be9-4199-a02f-a9fe7da59c42 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:55.383006 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-4141fd44-2be9-4199-a02f-a9fe7da59c42 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:55.390156 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4141fd44-2be9-4199-a02f-a9fe7da59c42 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:55.390609 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4141fd44-2be9-4199-a02f-a9fe7da59c42 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:55.391408 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4141fd44-2be9-4199-a02f-a9fe7da59c42 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:55.391881 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4141fd44-2be9-4199-a02f-a9fe7da59c42 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:55.554260 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-4141fd44-2be9-4199-a02f-a9fe7da59c42 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:55.563010 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-4141fd44-2be9-4199-a02f-a9fe7da59c42 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1569 microversion: 2.1 time: 0.184659 Jul 26 12:59:55.570770 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 490/990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:55 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:56.015709 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-a9fc7e36-0c0f-4e9f-8b37-b451831ebb43 req-e287581b-9b9e-4c26-b17b-cc0f1f26c0ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1331709-485e-470a-9dcb-0b8832524597", "name": "network-vif-deleted", "tag": "b9c4967a-1f5b-4bc9-9c07-7d4a8cc5768f"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 12:59:56.025698 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-a9fc7e36-0c0f-4e9f-8b37-b451831ebb43 req-e287581b-9b9e-4c26-b17b-cc0f1f26c0ad service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:56.026149 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-a9fc7e36-0c0f-4e9f-8b37-b451831ebb43 req-e287581b-9b9e-4c26-b17b-cc0f1f26c0ad service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:56.037837 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-a9fc7e36-0c0f-4e9f-8b37-b451831ebb43 req-e287581b-9b9e-4c26-b17b-cc0f1f26c0ad service nova] Creating event network-vif-deleted:b9c4967a-1f5b-4bc9-9c07-7d4a8cc5768f for instance f1331709-485e-470a-9dcb-0b8832524597 on hv-cinder-85093 Jul 26 12:59:56.042651 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-a9fc7e36-0c0f-4e9f-8b37-b451831ebb43 req-e287581b-9b9e-4c26-b17b-cc0f1f26c0ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031163 Jul 26 12:59:56.043284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 501/991] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 12:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 12:59:56.593497 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5a1cf2fc-4e8e-438a-b122-e579533be2f3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:56.594135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-5a1cf2fc-4e8e-438a-b122-e579533be2f3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:56.603043 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a1cf2fc-4e8e-438a-b122-e579533be2f3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:56.603561 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a1cf2fc-4e8e-438a-b122-e579533be2f3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:56.604675 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a1cf2fc-4e8e-438a-b122-e579533be2f3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:56.604815 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a1cf2fc-4e8e-438a-b122-e579533be2f3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:56.642653 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a1cf2fc-4e8e-438a-b122-e579533be2f3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:56.643101 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5a1cf2fc-4e8e-438a-b122-e579533be2f3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:56.643670 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-5a1cf2fc-4e8e-438a-b122-e579533be2f3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lazy-loading 'fault' on Instance uuid f1331709-485e-470a-9dcb-0b8832524597 {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 12:59:56.687929 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-5a1cf2fc-4e8e-438a-b122-e579533be2f3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c556056d054689ab7b100f02404d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8383c3af34e46f2922ffb7f6d4963af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 12:59:56.696407 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-5a1cf2fc-4e8e-438a-b122-e579533be2f3 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 200 len: 1225 microversion: 2.1 time: 0.115528 Jul 26 12:59:56.697083 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 491/992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:56 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 12:59:57.720504 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8d5d73d9-a41f-478b-a322-528d1cb6cd72 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:57.721202 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-8d5d73d9-a41f-478b-a322-528d1cb6cd72 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] [instance: f1331709-485e-470a-9dcb-0b8832524597] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 12:59:57.727762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8d5d73d9-a41f-478b-a322-528d1cb6cd72 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:57.728217 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8d5d73d9-a41f-478b-a322-528d1cb6cd72 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:57.728983 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8d5d73d9-a41f-478b-a322-528d1cb6cd72 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 12:59:57.729426 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-8d5d73d9-a41f-478b-a322-528d1cb6cd72 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 12:59:57.744639 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-8d5d73d9-a41f-478b-a322-528d1cb6cd72 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] HTTP exception thrown: Instance f1331709-485e-470a-9dcb-0b8832524597 could not be found. Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8d5d73d9-a41f-478b-a322-528d1cb6cd72 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Request method failure captured: Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 HTTP/1.1 Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-P5yCrubdCAinJbnTg9rjOXWjy0CzVBvZEQlpAwHhYOH8giSKo-1jiWDMdUTtW9wUPDtNP-o1sM6mQdu0JUeqNd7LxbNnQhrRHZ9CqMKqRFTfhLr9Sag5ScynDWcKvScqITS0TlavqPL4BxmJknTpnGpBXOq1ayt0xJmpFMB4hNcDI Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: b8383c3af34e46f2922ffb7f6d4963af Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-TestShelveInstance-632963183 Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 12:59:57.746284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 12:59:57.747972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b8383c3af34e46f2922ffb7f6d4963af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b8383c3af34e46f2922ffb7f6d4963af", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b8383c3af34e46f2922ffb7f6d4963af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b8383c3af34e46f2922ffb7f6d4963af"}]}] Jul 26 12:59:57.747972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-TestShelveInstance-632963183 Jul 26 12:59:57.747972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: b8383c3af34e46f2922ffb7f6d4963af Jul 26 12:59:57.747972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-TestShelveInstance-632963183 Jul 26 12:59:57.747972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-TestShelveInstance-632963183-project Jul 26 12:59:57.747972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 12:59:57.747972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 12:59:57.747972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: b6c556056d054689ab7b100f02404d3f Jul 26 12:59:57.747972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-TestShelveInstance-632963183-project Jul 26 12:59:57.747972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 12:59:57.747972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance f1331709-485e-470a-9dcb-0b8832524597 could not be found. Jul 26 12:59:57.747972 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': 'f1331709-485e-470a-9dcb-0b8832524597'} Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1331709-485e-470a-9dcb-0b8832524597 could not be found. Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 12:59:57.748916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1331709-485e-470a-9dcb-0b8832524597 could not be found. Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1331709-485e-470a-9dcb-0b8832524597 could not be found. Jul 26 12:59:57.750452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 12:59:57.751955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8d5d73d9-a41f-478b-a322-528d1cb6cd72 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Returning 404 to user: Instance f1331709-485e-470a-9dcb-0b8832524597 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 12:59:57.751955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8d5d73d9-a41f-478b-a322-528d1cb6cd72 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597" status: 404 len: 111 microversion: 2.1 time: 0.032033 Jul 26 12:59:57.751955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 502/993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 12:59:57 2022] GET /compute/v2.1/servers/f1331709-485e-470a-9dcb-0b8832524597 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 12:59:57.912318 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a4802190-c542-4c21-a8c8-799fbd888d49 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] Calling method '.version_select at 0x7f65f51d0b80>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 12:59:57.932574 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a4802190-c542-4c21-a8c8-799fbd888d49 tempest-TestShelveInstance-632963183 tempest-TestShelveInstance-632963183-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1387980769" status: 202 len: 0 microversion: 2.1 time: 0.024025 Jul 26 12:59:57.934042 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 492/994] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Jul 26 12:59:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1387980769 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 13:00:06.034518 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ec0af90f-2ff5-4646-a3af-e7139203ceba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:06.038386 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ec0af90f-2ff5-4646-a3af-e7139203ceba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:06.046247 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ec0af90f-2ff5-4646-a3af-e7139203ceba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:06.046977 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ec0af90f-2ff5-4646-a3af-e7139203ceba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:06.048243 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ec0af90f-2ff5-4646-a3af-e7139203ceba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:06.048911 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ec0af90f-2ff5-4646-a3af-e7139203ceba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:06.088827 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ec0af90f-2ff5-4646-a3af-e7139203ceba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058608 Jul 26 13:00:06.090095 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 503/995] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 13:00:06 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 13:00:06.156622 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-027b2fef-76aa-4029-81dd-4ffeffee1501 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:06.157096 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-027b2fef-76aa-4029-81dd-4ffeffee1501 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:06.163113 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-027b2fef-76aa-4029-81dd-4ffeffee1501 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:06.163846 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-027b2fef-76aa-4029-81dd-4ffeffee1501 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:06.164630 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-027b2fef-76aa-4029-81dd-4ffeffee1501 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:06.165018 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-027b2fef-76aa-4029-81dd-4ffeffee1501 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:06.194803 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-027b2fef-76aa-4029-81dd-4ffeffee1501 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Going to try to terminate instance {{(pid=129308) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 13:00:06.335828 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-027b2fef-76aa-4029-81dd-4ffeffee1501 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 204 len: 0 microversion: 2.1 time: 0.183456 Jul 26 13:00:06.342436 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 493/996] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 13:00:06 2022] DELETE /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 13:00:06.347532 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-07b41c28-9f13-4bfd-96ae-e74e157a2625 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:06.348185 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-07b41c28-9f13-4bfd-96ae-e74e157a2625 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:06.358140 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-07b41c28-9f13-4bfd-96ae-e74e157a2625 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:06.361415 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-07b41c28-9f13-4bfd-96ae-e74e157a2625 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:06.363349 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-07b41c28-9f13-4bfd-96ae-e74e157a2625 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:06.364654 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-07b41c28-9f13-4bfd-96ae-e74e157a2625 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:06.533699 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-07b41c28-9f13-4bfd-96ae-e74e157a2625 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:06.542843 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-07b41c28-9f13-4bfd-96ae-e74e157a2625 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1672 microversion: 2.1 time: 0.199106 Jul 26 13:00:06.544076 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 504/997] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:06 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1672 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:07.568256 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-fe7d4c68-f4f1-4356-9d2d-0a088bae9c11 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:07.569893 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-fe7d4c68-f4f1-4356-9d2d-0a088bae9c11 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:07.581425 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fe7d4c68-f4f1-4356-9d2d-0a088bae9c11 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:07.581905 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fe7d4c68-f4f1-4356-9d2d-0a088bae9c11 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:07.582959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fe7d4c68-f4f1-4356-9d2d-0a088bae9c11 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:07.583106 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-fe7d4c68-f4f1-4356-9d2d-0a088bae9c11 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:07.671208 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-435118186", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1602648222", "security_groups": [{"name": "tempest-secgroup-smoke-1409511889"}], "block_device_mapping_v2": [{"uuid": "32bd476d-e5f5-40f8-aca0-b0ef4dff3c59", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8b53c01d-8651-463b-8de8-06dcdf11a64f"}]}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:07.806916 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.network.neutron [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] validate_networks() for [('8b53c01d-8651-463b-8de8-06dcdf11a64f', None, None, None, None, None)] {{(pid=129307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 13:00:07.877178 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-fe7d4c68-f4f1-4356-9d2d-0a088bae9c11 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:07.894764 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-fe7d4c68-f4f1-4356-9d2d-0a088bae9c11 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1672 microversion: 2.1 time: 0.331112 Jul 26 13:00:07.895749 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 494/998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:07 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1672 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:08.286310 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Flavor limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 13:00:08.286744 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Image limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 13:00:08.287611 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Flavor pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 13:00:08.288157 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Image pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 13:00:08.288686 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 13:00:08.300258 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:08.300708 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:08.301651 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:08.302103 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:08.321960 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Getting quotas for project a2522985c6df452dabe2010e5f6bed35. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 13:00:08.326480 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Getting quotas for user 94efba410653451da2e9977d746633f6 and project a2522985c6df452dabe2010e5f6bed35. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 13:00:08.411953 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Going to run 1 instances... {{(pid=129307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 13:00:08.414157 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='32bd476d-e5f5-40f8-aca0-b0ef4dff3c59',volume_size=None,volume_type=None)] {{(pid=129307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 13:00:08.632499 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e23bf1e9-54c9-4cd6-b8ea-ee42c5006449 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.966065 Jul 26 13:00:08.634105 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 505/999] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 13:00:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 13:00:08.645485 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-972a0de5-8e8d-47d4-b358-bc5714d97ac6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:08.646778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-972a0de5-8e8d-47d4-b358-bc5714d97ac6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:08.746324 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-972a0de5-8e8d-47d4-b358-bc5714d97ac6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:08.754952 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-972a0de5-8e8d-47d4-b358-bc5714d97ac6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1094 microversion: 2.1 time: 0.113370 Jul 26 13:00:08.755529 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 495/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:08 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1094 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:08.920391 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-61e93c40-6b3a-4cd8-b18e-6772bc616beb tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:08.921022 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-61e93c40-6b3a-4cd8-b18e-6772bc616beb tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:08.936483 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-61e93c40-6b3a-4cd8-b18e-6772bc616beb tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:08.937008 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-61e93c40-6b3a-4cd8-b18e-6772bc616beb tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:08.938275 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-61e93c40-6b3a-4cd8-b18e-6772bc616beb tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:08.941258 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-61e93c40-6b3a-4cd8-b18e-6772bc616beb tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:09.229711 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-61e93c40-6b3a-4cd8-b18e-6772bc616beb tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:09.237787 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-61e93c40-6b3a-4cd8-b18e-6772bc616beb tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1672 microversion: 2.1 time: 0.321803 Jul 26 13:00:09.238474 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 506/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:08 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1672 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:09.781640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6e5a375b-8529-45d0-813e-5ca6c4eb2a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:09.782422 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6e5a375b-8529-45d0-813e-5ca6c4eb2a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:09.803838 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6e5a375b-8529-45d0-813e-5ca6c4eb2a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:09.804291 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6e5a375b-8529-45d0-813e-5ca6c4eb2a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:09.805493 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6e5a375b-8529-45d0-813e-5ca6c4eb2a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:09.806246 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6e5a375b-8529-45d0-813e-5ca6c4eb2a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:09.809758 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-4914359f-8af7-4da0-9095-5e781a420b3f req-d73b21c4-d734-40fc-891a-fda848debcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a1a3713-8bde-42c4-ad34-76974193ab34", "name": "network-vif-deleted", "tag": "d45328ab-0a5d-4356-ac91-b30351ad1eea"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:09.821387 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-4914359f-8af7-4da0-9095-5e781a420b3f req-d73b21c4-d734-40fc-891a-fda848debcd9 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:09.822115 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-4914359f-8af7-4da0-9095-5e781a420b3f req-d73b21c4-d734-40fc-891a-fda848debcd9 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:09.847869 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-4914359f-8af7-4da0-9095-5e781a420b3f req-d73b21c4-d734-40fc-891a-fda848debcd9 service nova] Creating event network-vif-deleted:d45328ab-0a5d-4356-ac91-b30351ad1eea for instance 5a1a3713-8bde-42c4-ad34-76974193ab34 on hv-cinder-85093 Jul 26 13:00:09.872826 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-4914359f-8af7-4da0-9095-5e781a420b3f req-d73b21c4-d734-40fc-891a-fda848debcd9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070884 Jul 26 13:00:09.895564 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 507/1002] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 13:00:10.055061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6e5a375b-8529-45d0-813e-5ca6c4eb2a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:10.073049 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6e5a375b-8529-45d0-813e-5ca6c4eb2a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1192 microversion: 2.1 time: 0.292463 Jul 26 13:00:10.074809 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 496/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:09 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1192 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:10.264308 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-cfa2d8f7-9a06-4a9d-bf58-0dbbacab4f7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:10.265774 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-cfa2d8f7-9a06-4a9d-bf58-0dbbacab4f7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:10.273408 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfa2d8f7-9a06-4a9d-bf58-0dbbacab4f7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:10.274116 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfa2d8f7-9a06-4a9d-bf58-0dbbacab4f7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:10.274911 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfa2d8f7-9a06-4a9d-bf58-0dbbacab4f7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:10.275544 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfa2d8f7-9a06-4a9d-bf58-0dbbacab4f7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:10.312795 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfa2d8f7-9a06-4a9d-bf58-0dbbacab4f7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:10.313257 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfa2d8f7-9a06-4a9d-bf58-0dbbacab4f7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:10.313714 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-cfa2d8f7-9a06-4a9d-bf58-0dbbacab4f7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lazy-loading 'fault' on Instance uuid 5a1a3713-8bde-42c4-ad34-76974193ab34 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 13:00:10.395539 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-cfa2d8f7-9a06-4a9d-bf58-0dbbacab4f7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:10.421268 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-cfa2d8f7-9a06-4a9d-bf58-0dbbacab4f7d tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 200 len: 1328 microversion: 2.1 time: 0.162066 Jul 26 13:00:10.434829 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 508/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:10 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 1328 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:11.099056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ff403c6d-cd48-499e-9662-8e99d581eed8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:11.100292 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ff403c6d-cd48-499e-9662-8e99d581eed8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:11.110336 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff403c6d-cd48-499e-9662-8e99d581eed8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:11.111943 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff403c6d-cd48-499e-9662-8e99d581eed8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:11.117459 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff403c6d-cd48-499e-9662-8e99d581eed8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:11.118626 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ff403c6d-cd48-499e-9662-8e99d581eed8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:11.262948 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-ff403c6d-cd48-499e-9662-8e99d581eed8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:11.272009 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ff403c6d-cd48-499e-9662-8e99d581eed8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1210 microversion: 2.1 time: 0.177362 Jul 26 13:00:11.277365 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 497/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:11 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1210 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:11.444571 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b576c8d0-1845-4e3f-a13a-7987fc513177 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:11.445720 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b576c8d0-1845-4e3f-a13a-7987fc513177 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:11.454693 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b576c8d0-1845-4e3f-a13a-7987fc513177 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:11.459356 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b576c8d0-1845-4e3f-a13a-7987fc513177 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:11.460568 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b576c8d0-1845-4e3f-a13a-7987fc513177 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:11.464885 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b576c8d0-1845-4e3f-a13a-7987fc513177 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:11.509139 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-b576c8d0-1845-4e3f-a13a-7987fc513177 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] HTTP exception thrown: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b576c8d0-1845-4e3f-a13a-7987fc513177 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Request method failure captured: Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 HTTP/1.1 Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-SdIf3Y4TVo9U7UWKHnTjBEufXJrsSFvXW5TQj_ZiGlLFBFsa56pSO2_zeCIWDwIfNkmaCL9cYUFbz3RD2bH5osmaZkzTX7bJfngAJF1a06imq_8or886Sz18xszNAz8Ua2aSM728DAg5lB_RKDy5e67-4983nf8iNpwh17PVanNiU Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 429715c1b71244bcbbf9f30190d25823 Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 13:00:11.516049 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 13:00:11.517706 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/429715c1b71244bcbbf9f30190d25823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_429715c1b71244bcbbf9f30190d25823", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/429715c1b71244bcbbf9f30190d25823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/429715c1b71244bcbbf9f30190d25823"}]}] Jul 26 13:00:11.517706 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:00:11.517706 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 429715c1b71244bcbbf9f30190d25823 Jul 26 13:00:11.517706 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:00:11.517706 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeTestJSON-1519996836-project Jul 26 13:00:11.517706 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 13:00:11.517706 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 13:00:11.517706 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: d480ea8c18634b88b3248a80422aa798 Jul 26 13:00:11.517706 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeTestJSON-1519996836-project Jul 26 13:00:11.517706 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 13:00:11.517706 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:00:11.517706 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '5a1a3713-8bde-42c4-ad34-76974193ab34'} Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:00:11.518525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:00:11.519824 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:00:11.523711 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b576c8d0-1845-4e3f-a13a-7987fc513177 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Returning 404 to user: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:00:11.529205 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b576c8d0-1845-4e3f-a13a-7987fc513177 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 404 len: 111 microversion: 2.1 time: 0.088672 Jul 26 13:00:11.530666 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 509/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:11 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 13:00:11.548124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3d6c808f-9b28-4cb4-8ec1-277c0417f2c5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '.version_select at 0x7f65f51d03a0>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:11.598612 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3d6c808f-9b28-4cb4-8ec1-277c0417f2c5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814775866" status: 202 len: 0 microversion: 2.1 time: 0.063544 Jul 26 13:00:11.599251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 498/1007] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Jul 26 13:00:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1814775866 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 13:00:12.298934 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-06c9421b-4e80-4864-8382-cf4a00bb8da3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:12.299556 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-06c9421b-4e80-4864-8382-cf4a00bb8da3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:12.308887 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-06c9421b-4e80-4864-8382-cf4a00bb8da3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:12.309337 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-06c9421b-4e80-4864-8382-cf4a00bb8da3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:12.310120 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-06c9421b-4e80-4864-8382-cf4a00bb8da3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:12.310572 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-06c9421b-4e80-4864-8382-cf4a00bb8da3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:12.607225 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-06c9421b-4e80-4864-8382-cf4a00bb8da3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:12.621436 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-06c9421b-4e80-4864-8382-cf4a00bb8da3 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1266 microversion: 2.1 time: 0.326626 Jul 26 13:00:12.622124 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 510/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:12 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:12.802868 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-2822ac23-42bd-4eb1-a927-13553906b7f1 req-8cd6d5d0-2130-498e-a8c1-e065f10696f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ddf07f-628a-4aca-8e71-e2ad95e160a2", "tag": "56458652-0240-4463-b181-f1a431b8e38c"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:12.824468 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-2822ac23-42bd-4eb1-a927-13553906b7f1 req-8cd6d5d0-2130-498e-a8c1-e065f10696f3 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:12.827813 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-2822ac23-42bd-4eb1-a927-13553906b7f1 req-8cd6d5d0-2130-498e-a8c1-e065f10696f3 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:12.840772 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-2822ac23-42bd-4eb1-a927-13553906b7f1 req-8cd6d5d0-2130-498e-a8c1-e065f10696f3 service nova] Creating event network-changed:56458652-0240-4463-b181-f1a431b8e38c for instance e0ddf07f-628a-4aca-8e71-e2ad95e160a2 on hv-cinder-85093 Jul 26 13:00:12.846275 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-2822ac23-42bd-4eb1-a927-13553906b7f1 req-8cd6d5d0-2130-498e-a8c1-e065f10696f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047098 Jul 26 13:00:12.848045 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 499/1009] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:00:13.643525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-eeb56d01-b748-4cab-ad76-6538cf9cae5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:13.644955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-eeb56d01-b748-4cab-ad76-6538cf9cae5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:13.655344 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eeb56d01-b748-4cab-ad76-6538cf9cae5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:13.662495 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eeb56d01-b748-4cab-ad76-6538cf9cae5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:13.664704 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eeb56d01-b748-4cab-ad76-6538cf9cae5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:13.665371 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-eeb56d01-b748-4cab-ad76-6538cf9cae5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:13.904967 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-626bbecd-3f67-4df9-912f-f106c8fa5b6e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Action: 'create', calling method: .version_select at 0x7f65f52c3550>, body: {"keypair": {"name": "tempest-keypair-1305006948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6c1PAqPUKVdnYHuWyPFFNQQQ5uXHD/JYQgxyoJrKyNvrCoBH4lH+aV3mZd6wjuSaoD3gJSougQZwZSdkrf9osDZTyr0vMjp996DWaa9u+WdafmPPhTBDt2wZnjwqoaSA=="}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:13.937258 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-626bbecd-3f67-4df9-912f-f106c8fa5b6e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Getting quotas for project 429715c1b71244bcbbf9f30190d25823. Resources: {'key_pairs'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 13:00:13.942949 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.quota [None req-626bbecd-3f67-4df9-912f-f106c8fa5b6e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Getting quotas for user d480ea8c18634b88b3248a80422aa798 and project 429715c1b71244bcbbf9f30190d25823. Resources: {'key_pairs'} {{(pid=129308) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 13:00:13.976471 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-626bbecd-3f67-4df9-912f-f106c8fa5b6e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.076535 Jul 26 13:00:13.985265 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 500/1010] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Jul 26 13:00:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:00:14.062097 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-eeb56d01-b748-4cab-ad76-6538cf9cae5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:14.090259 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-eeb56d01-b748-4cab-ad76-6538cf9cae5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1266 microversion: 2.1 time: 0.450449 Jul 26 13:00:14.105414 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 511/1011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:13 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1266 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:15.123125 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-261b6891-d3d1-4900-a565-246f98f55e16 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:15.128873 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-261b6891-d3d1-4900-a565-246f98f55e16 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:15.143052 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-261b6891-d3d1-4900-a565-246f98f55e16 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:15.145178 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-261b6891-d3d1-4900-a565-246f98f55e16 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:15.149260 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-261b6891-d3d1-4900-a565-246f98f55e16 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:15.150317 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-261b6891-d3d1-4900-a565-246f98f55e16 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:15.425385 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-261b6891-d3d1-4900-a565-246f98f55e16 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:15.438084 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-261b6891-d3d1-4900-a565-246f98f55e16 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1266 microversion: 2.1 time: 0.323670 Jul 26 13:00:15.441918 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 501/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:15 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:15.968282 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1148119926", "imageRef": "94c3fed2-2231-4932-8145-35db880323f4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a4b606f7-2541-4a19-ae64-86a063826c2e"}], "security_groups": [{"name": "tempest-securitygroup--422777110"}], "key_name": "tempest-keypair-1305006948", "user_data": "}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:16.140080 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.network.neutron [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] validate_networks() for [('a4b606f7-2541-4a19-ae64-86a063826c2e', None, None, None, None, None)] {{(pid=129307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 13:00:16.462762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d4bc05aa-57c0-4d3a-bf9f-9a7090068f43 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:16.463371 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d4bc05aa-57c0-4d3a-bf9f-9a7090068f43 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:16.475160 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d4bc05aa-57c0-4d3a-bf9f-9a7090068f43 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:16.475608 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d4bc05aa-57c0-4d3a-bf9f-9a7090068f43 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:16.476396 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d4bc05aa-57c0-4d3a-bf9f-9a7090068f43 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:16.476997 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d4bc05aa-57c0-4d3a-bf9f-9a7090068f43 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:16.676770 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d4bc05aa-57c0-4d3a-bf9f-9a7090068f43 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:16.694406 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d4bc05aa-57c0-4d3a-bf9f-9a7090068f43 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1266 microversion: 2.1 time: 0.235317 Jul 26 13:00:16.697976 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 502/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:16 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 13:00:16.914041 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Flavor limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 13:00:16.914724 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Image limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 13:00:16.915591 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Flavor pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 13:00:16.916257 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Image pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 13:00:16.917617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 13:00:16.928412 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:16.929162 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:16.930182 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:16.930718 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:16.955250 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Getting quotas for project 429715c1b71244bcbbf9f30190d25823. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 13:00:16.960641 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Getting quotas for user d480ea8c18634b88b3248a80422aa798 and project 429715c1b71244bcbbf9f30190d25823. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 13:00:16.977548 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Going to run 1 instances... {{(pid=129307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 13:00:16.981591 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='94c3fed2-2231-4932-8145-35db880323f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 13:00:17.037886 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-92e5e4aa-e66d-4149-bbda-56d6b401f63b tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.074946 Jul 26 13:00:17.039155 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 512/1014] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 13:00:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 13:00:17.050834 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e98145eb-eb56-485a-a27f-c75d15f6619f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:17.051861 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e98145eb-eb56-485a-a27f-c75d15f6619f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:17.110727 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e98145eb-eb56-485a-a27f-c75d15f6619f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:17.118039 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e98145eb-eb56-485a-a27f-c75d15f6619f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 200 len: 1238 microversion: 2.1 time: 0.071398 Jul 26 13:00:17.119269 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 503/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:17 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:17.718580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1f4e7205-5bf7-4ca9-8003-8404c9803662 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:17.719197 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1f4e7205-5bf7-4ca9-8003-8404c9803662 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:17.726777 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1f4e7205-5bf7-4ca9-8003-8404c9803662 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:17.727617 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1f4e7205-5bf7-4ca9-8003-8404c9803662 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:17.728597 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1f4e7205-5bf7-4ca9-8003-8404c9803662 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:17.729205 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1f4e7205-5bf7-4ca9-8003-8404c9803662 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:17.895138 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-1f4e7205-5bf7-4ca9-8003-8404c9803662 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:17.905973 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1f4e7205-5bf7-4ca9-8003-8404c9803662 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1266 microversion: 2.1 time: 0.192765 Jul 26 13:00:17.906660 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 513/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:17 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:18.142380 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c61b62c0-9a48-4f40-bdee-b06df145fbf9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:18.144486 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c61b62c0-9a48-4f40-bdee-b06df145fbf9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:18.169565 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c61b62c0-9a48-4f40-bdee-b06df145fbf9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:18.170806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c61b62c0-9a48-4f40-bdee-b06df145fbf9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:18.172816 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c61b62c0-9a48-4f40-bdee-b06df145fbf9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:18.173494 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c61b62c0-9a48-4f40-bdee-b06df145fbf9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:18.294162 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c61b62c0-9a48-4f40-bdee-b06df145fbf9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:18.302354 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c61b62c0-9a48-4f40-bdee-b06df145fbf9 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 200 len: 1308 microversion: 2.1 time: 0.166037 Jul 26 13:00:18.302923 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 504/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:18 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 1308 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:18.927062 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-cfaa12e1-b352-4a08-b996-2f8b2db5eb5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:18.927597 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-cfaa12e1-b352-4a08-b996-2f8b2db5eb5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:18.940215 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfaa12e1-b352-4a08-b996-2f8b2db5eb5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:18.940716 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfaa12e1-b352-4a08-b996-2f8b2db5eb5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:18.941545 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfaa12e1-b352-4a08-b996-2f8b2db5eb5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:18.946053 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-cfaa12e1-b352-4a08-b996-2f8b2db5eb5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:19.313699 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-cfaa12e1-b352-4a08-b996-2f8b2db5eb5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:19.325578 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-cfaa12e1-b352-4a08-b996-2f8b2db5eb5f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1266 microversion: 2.1 time: 0.402284 Jul 26 13:00:19.339663 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-852ef77e-69c3-4f53-9f60-edc75947f65a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:19.339663 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-852ef77e-69c3-4f53-9f60-edc75947f65a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:19.339663 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-852ef77e-69c3-4f53-9f60-edc75947f65a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:19.339663 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-852ef77e-69c3-4f53-9f60-edc75947f65a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:19.341051 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 514/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:18 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1266 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:19.346495 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-852ef77e-69c3-4f53-9f60-edc75947f65a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:19.347357 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-852ef77e-69c3-4f53-9f60-edc75947f65a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:19.405498 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:19.590387 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-852ef77e-69c3-4f53-9f60-edc75947f65a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:19.598703 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-852ef77e-69c3-4f53-9f60-edc75947f65a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 200 len: 1363 microversion: 2.1 time: 0.275950 Jul 26 13:00:19.599556 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 505/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:19 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 13:00:20.349745 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4de4296e-1662-4809-82e1-5a4241232a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:20.350639 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4de4296e-1662-4809-82e1-5a4241232a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:20.355333 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:20.377036 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4de4296e-1662-4809-82e1-5a4241232a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:20.380061 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4de4296e-1662-4809-82e1-5a4241232a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:20.381193 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4de4296e-1662-4809-82e1-5a4241232a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:20.386603 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4de4296e-1662-4809-82e1-5a4241232a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:20.397339 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=83 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:20.574292 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-1aaf820a-fa47-4886-a926-9f3815a4f315 req-47e0f06e-157d-49a2-aafc-d98725b513ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574f5f50-3fa4-4961-a4cc-8991f97f95a6", "tag": "baf28fd5-13a2-48aa-a2c6-2e4f3dd2ccaf"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:20.580178 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:20.593669 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-1aaf820a-fa47-4886-a926-9f3815a4f315 req-47e0f06e-157d-49a2-aafc-d98725b513ce service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:20.594123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-1aaf820a-fa47-4886-a926-9f3815a4f315 req-47e0f06e-157d-49a2-aafc-d98725b513ce service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:20.632430 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-1aaf820a-fa47-4886-a926-9f3815a4f315 req-47e0f06e-157d-49a2-aafc-d98725b513ce service nova] Creating event network-changed:baf28fd5-13a2-48aa-a2c6-2e4f3dd2ccaf for instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 on hv-cinder-85093 Jul 26 13:00:20.644908 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-1aaf820a-fa47-4886-a926-9f3815a4f315 req-47e0f06e-157d-49a2-aafc-d98725b513ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071581 Jul 26 13:00:20.646202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 506/1020] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 13:00:20.652502 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-c1b38db0-b82e-4da9-9d66-4ec71df79511 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:20.653449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-c1b38db0-b82e-4da9-9d66-4ec71df79511 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:20.672587 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c1b38db0-b82e-4da9-9d66-4ec71df79511 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:20.673132 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c1b38db0-b82e-4da9-9d66-4ec71df79511 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:20.674027 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c1b38db0-b82e-4da9-9d66-4ec71df79511 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:20.674553 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-c1b38db0-b82e-4da9-9d66-4ec71df79511 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:20.860348 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4de4296e-1662-4809-82e1-5a4241232a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:20.871167 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4de4296e-1662-4809-82e1-5a4241232a89 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1266 microversion: 2.1 time: 0.525117 Jul 26 13:00:20.878015 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 515/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:20 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1266 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:20.911889 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-c1b38db0-b82e-4da9-9d66-4ec71df79511 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:20.920606 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-c1b38db0-b82e-4da9-9d66-4ec71df79511 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 200 len: 1363 microversion: 2.1 time: 0.272922 Jul 26 13:00:20.921745 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 507/1022] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:20 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:21.902181 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-842d8ac3-6eda-4503-92e9-e3bfce04b4d0 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:21.902810 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-842d8ac3-6eda-4503-92e9-e3bfce04b4d0 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:21.919750 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-842d8ac3-6eda-4503-92e9-e3bfce04b4d0 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:21.920479 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-842d8ac3-6eda-4503-92e9-e3bfce04b4d0 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:21.921478 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-842d8ac3-6eda-4503-92e9-e3bfce04b4d0 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:21.922146 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-842d8ac3-6eda-4503-92e9-e3bfce04b4d0 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:21.942509 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1bbf971e-4471-413e-a0f9-7397577cf1c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:21.943161 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1bbf971e-4471-413e-a0f9-7397577cf1c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:21.950379 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1bbf971e-4471-413e-a0f9-7397577cf1c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:21.950880 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1bbf971e-4471-413e-a0f9-7397577cf1c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:21.951778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1bbf971e-4471-413e-a0f9-7397577cf1c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:21.952223 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1bbf971e-4471-413e-a0f9-7397577cf1c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:22.192791 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-842d8ac3-6eda-4503-92e9-e3bfce04b4d0 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:22.194059 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-1bbf971e-4471-413e-a0f9-7397577cf1c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:22.202978 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-842d8ac3-6eda-4503-92e9-e3bfce04b4d0 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1266 microversion: 2.1 time: 0.305835 Jul 26 13:00:22.207708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1bbf971e-4471-413e-a0f9-7397577cf1c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 200 len: 1363 microversion: 2.1 time: 0.268519 Jul 26 13:00:22.207823 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 516/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:21 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:22.208801 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 508/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:21 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:23.229011 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6f106fb6-7972-44d0-93d1-c96440722002 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:23.230771 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c7e0b4e5-c18b-4faf-8ed9-553e7a249124 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:23.231958 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-6f106fb6-7972-44d0-93d1-c96440722002 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:23.232818 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c7e0b4e5-c18b-4faf-8ed9-553e7a249124 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:23.248143 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6f106fb6-7972-44d0-93d1-c96440722002 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:23.250083 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c7e0b4e5-c18b-4faf-8ed9-553e7a249124 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:23.250826 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6f106fb6-7972-44d0-93d1-c96440722002 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:23.251623 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6f106fb6-7972-44d0-93d1-c96440722002 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:23.252093 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-6f106fb6-7972-44d0-93d1-c96440722002 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:23.256296 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c7e0b4e5-c18b-4faf-8ed9-553e7a249124 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:23.257111 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c7e0b4e5-c18b-4faf-8ed9-553e7a249124 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:23.257546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c7e0b4e5-c18b-4faf-8ed9-553e7a249124 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:23.422946 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-6f106fb6-7972-44d0-93d1-c96440722002 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:23.434327 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6f106fb6-7972-44d0-93d1-c96440722002 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 200 len: 1363 microversion: 2.1 time: 0.208498 Jul 26 13:00:23.435493 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 509/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:23 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:23.460019 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c7e0b4e5-c18b-4faf-8ed9-553e7a249124 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:23.468419 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c7e0b4e5-c18b-4faf-8ed9-553e7a249124 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1266 microversion: 2.1 time: 0.247694 Jul 26 13:00:23.469751 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 517/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:23 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:23.553508 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-63d3fc08-588c-470c-8ee4-bdd9dd087465 req-541169bd-00b1-418f-97c8-40a4db5d37a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ddf07f-628a-4aca-8e71-e2ad95e160a2", "name": "network-vif-plugged", "status": "completed", "tag": "56458652-0240-4463-b181-f1a431b8e38c"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:23.570069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-63d3fc08-588c-470c-8ee4-bdd9dd087465 req-541169bd-00b1-418f-97c8-40a4db5d37a8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:23.570526 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-63d3fc08-588c-470c-8ee4-bdd9dd087465 req-541169bd-00b1-418f-97c8-40a4db5d37a8 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:23.597922 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-63d3fc08-588c-470c-8ee4-bdd9dd087465 req-541169bd-00b1-418f-97c8-40a4db5d37a8 service nova] Creating event network-vif-plugged:56458652-0240-4463-b181-f1a431b8e38c for instance e0ddf07f-628a-4aca-8e71-e2ad95e160a2 on hv-cinder-85093 Jul 26 13:00:23.603614 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-63d3fc08-588c-470c-8ee4-bdd9dd087465 req-541169bd-00b1-418f-97c8-40a4db5d37a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053930 Jul 26 13:00:23.604568 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 510/1027] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:00:24.457589 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-fbe8e9c2-04cf-4b55-b35c-e19c2a3368c5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:24.458218 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-fbe8e9c2-04cf-4b55-b35c-e19c2a3368c5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:24.465442 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fbe8e9c2-04cf-4b55-b35c-e19c2a3368c5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:24.465984 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fbe8e9c2-04cf-4b55-b35c-e19c2a3368c5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:24.466850 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fbe8e9c2-04cf-4b55-b35c-e19c2a3368c5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:24.467302 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fbe8e9c2-04cf-4b55-b35c-e19c2a3368c5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:24.490966 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-2e223d32-0afc-4187-aa24-6b2b1298ebb6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:24.492324 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-2e223d32-0afc-4187-aa24-6b2b1298ebb6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:24.498994 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2e223d32-0afc-4187-aa24-6b2b1298ebb6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:24.499443 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2e223d32-0afc-4187-aa24-6b2b1298ebb6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:24.500235 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2e223d32-0afc-4187-aa24-6b2b1298ebb6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:24.500844 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2e223d32-0afc-4187-aa24-6b2b1298ebb6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:24.635525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-fbe8e9c2-04cf-4b55-b35c-e19c2a3368c5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:24.647434 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-fbe8e9c2-04cf-4b55-b35c-e19c2a3368c5 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 200 len: 1363 microversion: 2.1 time: 0.189996 Jul 26 13:00:24.649455 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 518/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:24 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 13:00:24.671776 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-2e223d32-0afc-4187-aa24-6b2b1298ebb6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:24.680497 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-2e223d32-0afc-4187-aa24-6b2b1298ebb6 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1266 microversion: 2.1 time: 0.194410 Jul 26 13:00:24.681639 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 511/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:24 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:25.628730 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-ef3e069e-f40f-47b7-a311-7bd67a5329ff req-1495bec6-f3ad-4f86-b1de-d82fcca22f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574f5f50-3fa4-4961-a4cc-8991f97f95a6", "name": "network-vif-plugged", "status": "completed", "tag": "baf28fd5-13a2-48aa-a2c6-2e4f3dd2ccaf"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:25.641462 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-ef3e069e-f40f-47b7-a311-7bd67a5329ff req-1495bec6-f3ad-4f86-b1de-d82fcca22f15 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:25.642329 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-ef3e069e-f40f-47b7-a311-7bd67a5329ff req-1495bec6-f3ad-4f86-b1de-d82fcca22f15 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:25.656844 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-ef3e069e-f40f-47b7-a311-7bd67a5329ff req-1495bec6-f3ad-4f86-b1de-d82fcca22f15 service nova] Creating event network-vif-plugged:baf28fd5-13a2-48aa-a2c6-2e4f3dd2ccaf for instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 on hv-cinder-85093 Jul 26 13:00:25.663782 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-ef3e069e-f40f-47b7-a311-7bd67a5329ff req-1495bec6-f3ad-4f86-b1de-d82fcca22f15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039480 Jul 26 13:00:25.669956 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f314c4e8-b148-4bea-a88c-6fe6a49d882f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:25.671980 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f314c4e8-b148-4bea-a88c-6fe6a49d882f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:25.681155 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 519/1030] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:00:25.691141 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f314c4e8-b148-4bea-a88c-6fe6a49d882f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:25.691981 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f314c4e8-b148-4bea-a88c-6fe6a49d882f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:25.692980 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f314c4e8-b148-4bea-a88c-6fe6a49d882f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:25.693840 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f314c4e8-b148-4bea-a88c-6fe6a49d882f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:25.704838 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-b472fa42-1cc4-4ec7-910b-8af9d4191cae tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:25.705849 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-b472fa42-1cc4-4ec7-910b-8af9d4191cae tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:25.712522 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b472fa42-1cc4-4ec7-910b-8af9d4191cae tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:25.713217 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b472fa42-1cc4-4ec7-910b-8af9d4191cae tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:25.714296 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b472fa42-1cc4-4ec7-910b-8af9d4191cae tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:25.714888 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-b472fa42-1cc4-4ec7-910b-8af9d4191cae tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:25.874530 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f314c4e8-b148-4bea-a88c-6fe6a49d882f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:25.883202 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f314c4e8-b148-4bea-a88c-6fe6a49d882f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 200 len: 1363 microversion: 2.1 time: 0.217961 Jul 26 13:00:25.884921 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 512/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:25 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:25.917300 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-b472fa42-1cc4-4ec7-910b-8af9d4191cae tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:25.925386 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-b472fa42-1cc4-4ec7-910b-8af9d4191cae tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1452 microversion: 2.1 time: 0.227129 Jul 26 13:00:25.939279 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 520/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:25 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1452 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:25.957806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5eea0b9b-859d-46fe-ba4d-ca3a2a269590 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:25.966180 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-5eea0b9b-859d-46fe-ba4d-ca3a2a269590 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:25.975574 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5eea0b9b-859d-46fe-ba4d-ca3a2a269590 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:25.976132 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5eea0b9b-859d-46fe-ba4d-ca3a2a269590 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:25.977060 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5eea0b9b-859d-46fe-ba4d-ca3a2a269590 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:25.977489 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-5eea0b9b-859d-46fe-ba4d-ca3a2a269590 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:26.188582 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-5eea0b9b-859d-46fe-ba4d-ca3a2a269590 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:26.196431 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-5eea0b9b-859d-46fe-ba4d-ca3a2a269590 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1452 microversion: 2.1 time: 0.242536 Jul 26 13:00:26.197321 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 513/1033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:25 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1452 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:26.910446 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2c9106e7-c6c6-41fd-91cd-88320f655b48 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:26.911061 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2c9106e7-c6c6-41fd-91cd-88320f655b48 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:26.921413 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2c9106e7-c6c6-41fd-91cd-88320f655b48 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:26.922177 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2c9106e7-c6c6-41fd-91cd-88320f655b48 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:26.923142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2c9106e7-c6c6-41fd-91cd-88320f655b48 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:26.923766 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2c9106e7-c6c6-41fd-91cd-88320f655b48 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:26.944787 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=4 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:26.971773 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=12 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:27.337694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-2c9106e7-c6c6-41fd-91cd-88320f655b48 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:27.348087 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2c9106e7-c6c6-41fd-91cd-88320f655b48 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 200 len: 1363 microversion: 2.1 time: 0.441848 Jul 26 13:00:27.349121 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 521/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:26 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 1363 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:28.370818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3707d8dc-1da9-4f2f-b8a3-a356d50f512f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:28.371430 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3707d8dc-1da9-4f2f-b8a3-a356d50f512f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:28.374330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=8 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:28.381793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3707d8dc-1da9-4f2f-b8a3-a356d50f512f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:28.381793 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3707d8dc-1da9-4f2f-b8a3-a356d50f512f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:28.382821 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3707d8dc-1da9-4f2f-b8a3-a356d50f512f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:28.383258 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3707d8dc-1da9-4f2f-b8a3-a356d50f512f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:28.513204 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1f0bd341-e86b-42fa-8689-7032a2f4f7c2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Action: 'create', calling method: .version_select at 0x7f65f5285940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1655821461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHOq4igkseuebzVH8dc0aCAnQHE4VwfvPyxllgpU8pR12/NhLHhcgGUVKP18B7412gADIRQNlt9+dS+3ocKpIEphe9mSmJXQAKTTMJKo58xO5vMf2K13O9azlXfbLlxWQ=="}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:28.529252 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-1f0bd341-e86b-42fa-8689-7032a2f4f7c2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Getting quotas for project 2ef477e2598b4c7bbd40c06ccd26112b. Resources: {'key_pairs'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 13:00:28.533949 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-1f0bd341-e86b-42fa-8689-7032a2f4f7c2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Getting quotas for user 68818cd15fad466cb7cb5584212fe2f9 and project 2ef477e2598b4c7bbd40c06ccd26112b. Resources: {'key_pairs'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 13:00:28.538727 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3707d8dc-1da9-4f2f-b8a3-a356d50f512f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:28.556505 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3707d8dc-1da9-4f2f-b8a3-a356d50f512f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 200 len: 1548 microversion: 2.1 time: 0.190161 Jul 26 13:00:28.557399 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 514/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:28 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 1548 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:28.578287 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1f0bd341-e86b-42fa-8689-7032a2f4f7c2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.069613 Jul 26 13:00:28.588789 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7acf3e84-86f9-49d3-ae69-426bbb2defef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:28.590190 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7acf3e84-86f9-49d3-ae69-426bbb2defef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:28.593694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 522/1036] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Jul 26 13:00:28 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:00:28.599607 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7acf3e84-86f9-49d3-ae69-426bbb2defef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:28.600556 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7acf3e84-86f9-49d3-ae69-426bbb2defef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:28.601858 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7acf3e84-86f9-49d3-ae69-426bbb2defef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:28.602512 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7acf3e84-86f9-49d3-ae69-426bbb2defef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:28.616122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-34c0571d-b63d-417d-9fa1-fda4fff4458a req-55c68d1d-9fb0-4025-9325-48b34847a615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ddf07f-628a-4aca-8e71-e2ad95e160a2", "tag": "56458652-0240-4463-b181-f1a431b8e38c"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:28.630122 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-34c0571d-b63d-417d-9fa1-fda4fff4458a req-55c68d1d-9fb0-4025-9325-48b34847a615 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:28.630654 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-34c0571d-b63d-417d-9fa1-fda4fff4458a req-55c68d1d-9fb0-4025-9325-48b34847a615 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:28.648975 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-34c0571d-b63d-417d-9fa1-fda4fff4458a req-55c68d1d-9fb0-4025-9325-48b34847a615 service nova] Creating event network-changed:56458652-0240-4463-b181-f1a431b8e38c for instance e0ddf07f-628a-4aca-8e71-e2ad95e160a2 on hv-cinder-85093 Jul 26 13:00:28.655061 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-34c0571d-b63d-417d-9fa1-fda4fff4458a req-55c68d1d-9fb0-4025-9325-48b34847a615 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042667 Jul 26 13:00:28.655999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 523/1037] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:00:28.662471 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1635381990", "imageRef": "8d1ed860-77b5-4a3f-a340-39c3bdff4f3a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1655821461", "networks": [{"uuid": "9766ffc1-69b3-49e3-a78c-0708627e1208"}]}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:28.732755 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.network.neutron [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] validate_networks() for [('9766ffc1-69b3-49e3-a78c-0708627e1208', None, None, None, None, None)] {{(pid=129307) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 13:00:28.739146 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7acf3e84-86f9-49d3-ae69-426bbb2defef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162259 Jul 26 13:00:28.748517 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 515/1038] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Jul 26 13:00:28 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 13:00:29.140299 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Flavor limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 13:00:29.140809 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Image limits 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 13:00:29.141766 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Flavor pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 13:00:29.142254 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Image pref 0:0:0 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 13:00:29.142740 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.virt.hardware [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 13:00:29.152257 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:29.152813 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:29.153685 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:29.154197 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:29.172719 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Getting quotas for project 2ef477e2598b4c7bbd40c06ccd26112b. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 13:00:29.180215 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.quota [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Getting quotas for user 68818cd15fad466cb7cb5584212fe2f9 and project 2ef477e2598b4c7bbd40c06ccd26112b. Resources: {'ram', 'instances', 'cores'} {{(pid=129307) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 13:00:29.191730 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Going to run 1 instances... {{(pid=129307) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 13:00:29.194503 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8d1ed860-77b5-4a3f-a340-39c3bdff4f3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129307) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 13:00:29.242494 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f867a585-e088-4940-851c-94b9daa41a62 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584050 Jul 26 13:00:29.249975 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 524/1039] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Jul 26 13:00:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 13:00:29.255146 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-be4fd077-fa1a-4785-bf95-f08eaa54d02e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:29.255773 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-be4fd077-fa1a-4785-bf95-f08eaa54d02e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:29.367295 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-be4fd077-fa1a-4785-bf95-f08eaa54d02e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:29.380325 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-be4fd077-fa1a-4785-bf95-f08eaa54d02e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1259 microversion: 2.1 time: 0.128810 Jul 26 13:00:29.381209 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 516/1040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:29 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1259 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:30.404859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-13d0e4bb-d48f-4c8e-877b-d9610a3e83c1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:30.413945 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-13d0e4bb-d48f-4c8e-877b-d9610a3e83c1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:30.424970 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-13d0e4bb-d48f-4c8e-877b-d9610a3e83c1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:30.426225 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-13d0e4bb-d48f-4c8e-877b-d9610a3e83c1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:30.427188 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-13d0e4bb-d48f-4c8e-877b-d9610a3e83c1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:30.427851 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-13d0e4bb-d48f-4c8e-877b-d9610a3e83c1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:30.489649 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-a45d1759-9b07-4c90-919d-79eeadfb3a77 req-5172c9c1-4dc3-496c-b908-118b5324addc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574f5f50-3fa4-4961-a4cc-8991f97f95a6", "tag": "baf28fd5-13a2-48aa-a2c6-2e4f3dd2ccaf"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:30.501239 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-a45d1759-9b07-4c90-919d-79eeadfb3a77 req-5172c9c1-4dc3-496c-b908-118b5324addc service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:30.501681 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-a45d1759-9b07-4c90-919d-79eeadfb3a77 req-5172c9c1-4dc3-496c-b908-118b5324addc service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:30.516426 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-a45d1759-9b07-4c90-919d-79eeadfb3a77 req-5172c9c1-4dc3-496c-b908-118b5324addc service nova] Creating event network-changed:baf28fd5-13a2-48aa-a2c6-2e4f3dd2ccaf for instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 on hv-cinder-85093 Jul 26 13:00:30.530321 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-a45d1759-9b07-4c90-919d-79eeadfb3a77 req-5172c9c1-4dc3-496c-b908-118b5324addc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044116 Jul 26 13:00:30.531250 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 517/1041] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 13:00:30.553616 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-13d0e4bb-d48f-4c8e-877b-d9610a3e83c1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:30.565836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-13d0e4bb-d48f-4c8e-877b-d9610a3e83c1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1317 microversion: 2.1 time: 0.164775 Jul 26 13:00:30.580332 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 525/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:30 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:31.592703 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d7b49c64-51b5-4828-987d-634b54d7e963 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:31.595374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d7b49c64-51b5-4828-987d-634b54d7e963 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:31.624509 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d7b49c64-51b5-4828-987d-634b54d7e963 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:31.624963 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d7b49c64-51b5-4828-987d-634b54d7e963 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:31.625783 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d7b49c64-51b5-4828-987d-634b54d7e963 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:31.626223 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d7b49c64-51b5-4828-987d-634b54d7e963 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:31.866177 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-d7b49c64-51b5-4828-987d-634b54d7e963 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:31.879021 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d7b49c64-51b5-4828-987d-634b54d7e963 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1359 microversion: 2.1 time: 0.294373 Jul 26 13:00:31.880356 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 518/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:31 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1359 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:32.904061 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-545c9466-0201-4078-9597-7825b2ec600a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:32.904982 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-545c9466-0201-4078-9597-7825b2ec600a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:32.913594 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-545c9466-0201-4078-9597-7825b2ec600a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:32.914484 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-545c9466-0201-4078-9597-7825b2ec600a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:32.915987 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-545c9466-0201-4078-9597-7825b2ec600a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:32.917229 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-545c9466-0201-4078-9597-7825b2ec600a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:33.068070 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-545c9466-0201-4078-9597-7825b2ec600a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:33.076367 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-545c9466-0201-4078-9597-7825b2ec600a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1359 microversion: 2.1 time: 0.177295 Jul 26 13:00:33.077038 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 526/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:32 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:34.098459 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-f8e3a8b2-e741-4896-90b1-a9536c49ca4e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:34.099737 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-f8e3a8b2-e741-4896-90b1-a9536c49ca4e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:34.106997 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8e3a8b2-e741-4896-90b1-a9536c49ca4e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:34.107434 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8e3a8b2-e741-4896-90b1-a9536c49ca4e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:34.108227 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8e3a8b2-e741-4896-90b1-a9536c49ca4e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:34.108665 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-f8e3a8b2-e741-4896-90b1-a9536c49ca4e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:34.259873 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-f8e3a8b2-e741-4896-90b1-a9536c49ca4e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:34.268435 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-f8e3a8b2-e741-4896-90b1-a9536c49ca4e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1359 microversion: 2.1 time: 0.173755 Jul 26 13:00:34.269007 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 519/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:34 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:35.294338 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-5eeb0487-a508-4207-972a-d78a0d6805cf tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:35.295393 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-5eeb0487-a508-4207-972a-d78a0d6805cf tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:35.306300 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5eeb0487-a508-4207-972a-d78a0d6805cf tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:35.307108 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5eeb0487-a508-4207-972a-d78a0d6805cf tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:35.308979 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5eeb0487-a508-4207-972a-d78a0d6805cf tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:35.309707 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-5eeb0487-a508-4207-972a-d78a0d6805cf tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:35.456469 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-5eeb0487-a508-4207-972a-d78a0d6805cf tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:35.464849 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-5eeb0487-a508-4207-972a-d78a0d6805cf tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1359 microversion: 2.1 time: 0.178208 Jul 26 13:00:35.465577 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 527/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:35 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 13:00:36.486337 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-90c238be-e1cb-4627-91c8-671b429443f1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:36.487134 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-90c238be-e1cb-4627-91c8-671b429443f1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:36.494328 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-90c238be-e1cb-4627-91c8-671b429443f1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:36.494818 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-90c238be-e1cb-4627-91c8-671b429443f1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:36.495724 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-90c238be-e1cb-4627-91c8-671b429443f1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:36.496176 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-90c238be-e1cb-4627-91c8-671b429443f1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:36.639264 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-90c238be-e1cb-4627-91c8-671b429443f1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:36.652970 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-90c238be-e1cb-4627-91c8-671b429443f1 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1359 microversion: 2.1 time: 0.170010 Jul 26 13:00:36.667879 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 520/1047] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:36 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:37.684694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c06d48da-4deb-4bfb-93e9-4bc9a8841e3d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:37.685408 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c06d48da-4deb-4bfb-93e9-4bc9a8841e3d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:37.692134 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c06d48da-4deb-4bfb-93e9-4bc9a8841e3d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:37.692512 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c06d48da-4deb-4bfb-93e9-4bc9a8841e3d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:37.693281 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c06d48da-4deb-4bfb-93e9-4bc9a8841e3d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:37.693712 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c06d48da-4deb-4bfb-93e9-4bc9a8841e3d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:37.841956 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c06d48da-4deb-4bfb-93e9-4bc9a8841e3d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:37.849342 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c06d48da-4deb-4bfb-93e9-4bc9a8841e3d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1359 microversion: 2.1 time: 0.168576 Jul 26 13:00:37.849908 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 528/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:37 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:38.871743 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-aab80150-8aab-4a74-b318-318cbcdd304a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:38.872635 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-aab80150-8aab-4a74-b318-318cbcdd304a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:38.883462 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aab80150-8aab-4a74-b318-318cbcdd304a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:38.885135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aab80150-8aab-4a74-b318-318cbcdd304a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:38.886582 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aab80150-8aab-4a74-b318-318cbcdd304a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:38.887110 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-aab80150-8aab-4a74-b318-318cbcdd304a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:39.139676 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-aab80150-8aab-4a74-b318-318cbcdd304a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:39.148940 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-aab80150-8aab-4a74-b318-318cbcdd304a tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1359 microversion: 2.1 time: 0.281721 Jul 26 13:00:39.149239 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 521/1049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:38 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:39.586710 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-2347a49a-b8ac-40e6-983f-746487e78c92 req-2aaf77ec-0cd3-4837-86cb-56778ec1a595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44eb7c3c-129d-48bc-90eb-ce1c60c10d2e", "tag": "9b53c6b7-b508-47dc-b083-ba526341c773"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:39.598854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=2 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:39.600083 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=10 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:39.618305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-2347a49a-b8ac-40e6-983f-746487e78c92 req-2aaf77ec-0cd3-4837-86cb-56778ec1a595 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:39.619134 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-2347a49a-b8ac-40e6-983f-746487e78c92 req-2aaf77ec-0cd3-4837-86cb-56778ec1a595 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:39.636294 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-2347a49a-b8ac-40e6-983f-746487e78c92 req-2aaf77ec-0cd3-4837-86cb-56778ec1a595 service nova] Creating event network-changed:9b53c6b7-b508-47dc-b083-ba526341c773 for instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e on hv-cinder-85093 Jul 26 13:00:39.643656 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-2347a49a-b8ac-40e6-983f-746487e78c92 req-2aaf77ec-0cd3-4837-86cb-56778ec1a595 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060401 Jul 26 13:00:39.644405 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 529/1050] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:00:40.170029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-46777c28-cc6e-4629-83dd-e056da6f631e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:40.170629 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-46777c28-cc6e-4629-83dd-e056da6f631e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:40.172648 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell0:SELECT=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:40.179242 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-46777c28-cc6e-4629-83dd-e056da6f631e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:40.179709 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-46777c28-cc6e-4629-83dd-e056da6f631e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:40.180480 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-46777c28-cc6e-4629-83dd-e056da6f631e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:40.180912 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-46777c28-cc6e-4629-83dd-e056da6f631e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:40.313286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-46777c28-cc6e-4629-83dd-e056da6f631e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:40.320887 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-46777c28-cc6e-4629-83dd-e056da6f631e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1359 microversion: 2.1 time: 0.154875 Jul 26 13:00:40.321449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 522/1051] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:40 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:41.342882 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e4294d87-1fcb-42ca-b051-984dfba348ab tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:41.343720 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e4294d87-1fcb-42ca-b051-984dfba348ab tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:41.350118 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e4294d87-1fcb-42ca-b051-984dfba348ab tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:41.350580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e4294d87-1fcb-42ca-b051-984dfba348ab tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:41.351336 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e4294d87-1fcb-42ca-b051-984dfba348ab tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:41.351792 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e4294d87-1fcb-42ca-b051-984dfba348ab tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:41.490118 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e4294d87-1fcb-42ca-b051-984dfba348ab tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:41.498231 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e4294d87-1fcb-42ca-b051-984dfba348ab tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1359 microversion: 2.1 time: 0.160628 Jul 26 13:00:41.498798 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 530/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:41 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:42.519773 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3c96f26f-444e-441a-a0c8-0822fe9a43f2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:42.520391 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3c96f26f-444e-441a-a0c8-0822fe9a43f2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:42.527142 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3c96f26f-444e-441a-a0c8-0822fe9a43f2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:42.527593 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3c96f26f-444e-441a-a0c8-0822fe9a43f2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:42.528370 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3c96f26f-444e-441a-a0c8-0822fe9a43f2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:42.528807 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3c96f26f-444e-441a-a0c8-0822fe9a43f2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:42.656500 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-3c96f26f-444e-441a-a0c8-0822fe9a43f2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:42.663961 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3c96f26f-444e-441a-a0c8-0822fe9a43f2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1359 microversion: 2.1 time: 0.148045 Jul 26 13:00:42.664522 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 523/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:42 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:43.685636 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d13180a8-4fe8-4c8b-99b8-92096e1559a0 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:43.686284 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d13180a8-4fe8-4c8b-99b8-92096e1559a0 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:43.692941 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d13180a8-4fe8-4c8b-99b8-92096e1559a0 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:43.693336 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d13180a8-4fe8-4c8b-99b8-92096e1559a0 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:43.694097 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d13180a8-4fe8-4c8b-99b8-92096e1559a0 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:43.694539 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d13180a8-4fe8-4c8b-99b8-92096e1559a0 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:43.825645 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d13180a8-4fe8-4c8b-99b8-92096e1559a0 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:43.833006 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d13180a8-4fe8-4c8b-99b8-92096e1559a0 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1359 microversion: 2.1 time: 0.151726 Jul 26 13:00:43.833567 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 531/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:43 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:44.853212 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-4fddf765-2595-48ba-8b40-552edd3e946f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:44.853800 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-4fddf765-2595-48ba-8b40-552edd3e946f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:44.860503 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4fddf765-2595-48ba-8b40-552edd3e946f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:44.860944 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4fddf765-2595-48ba-8b40-552edd3e946f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:44.861699 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4fddf765-2595-48ba-8b40-552edd3e946f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:44.862132 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-4fddf765-2595-48ba-8b40-552edd3e946f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:44.996626 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-4fddf765-2595-48ba-8b40-552edd3e946f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:45.004025 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-4fddf765-2595-48ba-8b40-552edd3e946f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1359 microversion: 2.1 time: 0.154593 Jul 26 13:00:45.004592 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 524/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:44 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:45.463734 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-61615aaa-18da-4446-a5af-dbb093bd0b14 req-f85459f0-896a-437d-aee9-08e78152293a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44eb7c3c-129d-48bc-90eb-ce1c60c10d2e", "name": "network-vif-plugged", "status": "completed", "tag": "9b53c6b7-b508-47dc-b083-ba526341c773"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:45.474565 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-61615aaa-18da-4446-a5af-dbb093bd0b14 req-f85459f0-896a-437d-aee9-08e78152293a service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:45.475183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-61615aaa-18da-4446-a5af-dbb093bd0b14 req-f85459f0-896a-437d-aee9-08e78152293a service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:45.486793 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-61615aaa-18da-4446-a5af-dbb093bd0b14 req-f85459f0-896a-437d-aee9-08e78152293a service nova] Creating event network-vif-plugged:9b53c6b7-b508-47dc-b083-ba526341c773 for instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e on hv-cinder-85093 Jul 26 13:00:45.491908 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-61615aaa-18da-4446-a5af-dbb093bd0b14 req-f85459f0-896a-437d-aee9-08e78152293a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032333 Jul 26 13:00:45.492696 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 532/1056] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:00:46.025466 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-615a4522-79b4-4bb7-8749-085913e01e29 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:46.026599 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-615a4522-79b4-4bb7-8749-085913e01e29 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:46.033033 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-615a4522-79b4-4bb7-8749-085913e01e29 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:46.033482 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-615a4522-79b4-4bb7-8749-085913e01e29 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:46.034255 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-615a4522-79b4-4bb7-8749-085913e01e29 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:46.034693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-615a4522-79b4-4bb7-8749-085913e01e29 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:46.053214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=100 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:46.168212 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-615a4522-79b4-4bb7-8749-085913e01e29 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:46.175711 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-615a4522-79b4-4bb7-8749-085913e01e29 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1359 microversion: 2.1 time: 0.154098 Jul 26 13:00:46.176493 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 525/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:46 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:47.197246 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-bbda26fb-0946-4ef3-9bb9-0334cc103792 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:47.198011 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-bbda26fb-0946-4ef3-9bb9-0334cc103792 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:47.204700 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bbda26fb-0946-4ef3-9bb9-0334cc103792 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:47.205149 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bbda26fb-0946-4ef3-9bb9-0334cc103792 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:47.205900 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bbda26fb-0946-4ef3-9bb9-0334cc103792 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:47.206335 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-bbda26fb-0946-4ef3-9bb9-0334cc103792 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:47.340524 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-bbda26fb-0946-4ef3-9bb9-0334cc103792 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:47.348030 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-bbda26fb-0946-4ef3-9bb9-0334cc103792 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1549 microversion: 2.1 time: 0.155192 Jul 26 13:00:47.348591 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 533/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:47 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:47.368431 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-dce1fecd-0042-4a21-b1ed-6e7a13aca2e2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:47.369042 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-dce1fecd-0042-4a21-b1ed-6e7a13aca2e2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:47.376849 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dce1fecd-0042-4a21-b1ed-6e7a13aca2e2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:47.377303 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dce1fecd-0042-4a21-b1ed-6e7a13aca2e2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:47.378239 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dce1fecd-0042-4a21-b1ed-6e7a13aca2e2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:47.378675 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dce1fecd-0042-4a21-b1ed-6e7a13aca2e2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:47.518518 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-dce1fecd-0042-4a21-b1ed-6e7a13aca2e2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:47.526443 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-dce1fecd-0042-4a21-b1ed-6e7a13aca2e2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1549 microversion: 2.1 time: 0.161399 Jul 26 13:00:47.527003 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 526/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:47 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:47.547300 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f7a3cdef-a9ba-4c16-9373-93f8d6302ada tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:47.552153 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-f7a3cdef-a9ba-4c16-9373-93f8d6302ada tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:47.552935 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f7a3cdef-a9ba-4c16-9373-93f8d6302ada tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Searching by: {'deleted': False, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b'} {{(pid=129307) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 13:00:47.559522 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f7a3cdef-a9ba-4c16-9373-93f8d6302ada tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:47.560019 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f7a3cdef-a9ba-4c16-9373-93f8d6302ada tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:47.560823 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f7a3cdef-a9ba-4c16-9373-93f8d6302ada tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:47.561267 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f7a3cdef-a9ba-4c16-9373-93f8d6302ada tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:47.652719 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.multi_cell_list [None req-f7a3cdef-a9ba-4c16-9373-93f8d6302ada tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129307) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 13:00:47.745267 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f7a3cdef-a9ba-4c16-9373-93f8d6302ada tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201981 Jul 26 13:00:47.745855 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 534/1060] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Jul 26 13:00:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 13:00:47.757010 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-58c21709-3718-4a18-91f1-6b9d5516910c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:47.757628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-58c21709-3718-4a18-91f1-6b9d5516910c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:47.764447 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-58c21709-3718-4a18-91f1-6b9d5516910c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:47.764901 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-58c21709-3718-4a18-91f1-6b9d5516910c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:47.765667 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-58c21709-3718-4a18-91f1-6b9d5516910c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:47.766107 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-58c21709-3718-4a18-91f1-6b9d5516910c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:47.892711 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-58c21709-3718-4a18-91f1-6b9d5516910c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:47.900154 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-58c21709-3718-4a18-91f1-6b9d5516910c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1549 microversion: 2.1 time: 0.147063 Jul 26 13:00:47.900723 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 527/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:47 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:49.438335 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-fc677f42-586b-47d9-85d2-cc6a8bda1e7e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13056486-3545-4140-a4d0-17ff9f0f2c23"}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:49.440573 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-fc677f42-586b-47d9-85d2-cc6a8bda1e7e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:49.447100 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fc677f42-586b-47d9-85d2-cc6a8bda1e7e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:49.447331 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fc677f42-586b-47d9-85d2-cc6a8bda1e7e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:49.448699 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fc677f42-586b-47d9-85d2-cc6a8bda1e7e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:49.449135 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fc677f42-586b-47d9-85d2-cc6a8bda1e7e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:49.519192 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=100 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:49.703982 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-fc677f42-586b-47d9-85d2-cc6a8bda1e7e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "POST /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269312 Jul 26 13:00:49.704521 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 535/1062] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 13:00:49 2022] POST /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:00:57.290988 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7dcb4ad1-7fbf-413c-a92e-cc20708398ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:00:57.291598 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7dcb4ad1-7fbf-413c-a92e-cc20708398ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:00:57.294719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=46 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:57.300121 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7dcb4ad1-7fbf-413c-a92e-cc20708398ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:57.300566 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7dcb4ad1-7fbf-413c-a92e-cc20708398ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:57.301333 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7dcb4ad1-7fbf-413c-a92e-cc20708398ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:57.301804 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7dcb4ad1-7fbf-413c-a92e-cc20708398ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:57.437514 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7dcb4ad1-7fbf-413c-a92e-cc20708398ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:00:57.445564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7dcb4ad1-7fbf-413c-a92e-cc20708398ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1595 microversion: 2.1 time: 0.158334 Jul 26 13:00:57.446122 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 528/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:00:57 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:00:59.378171 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell0:SELECT=2 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:59.382769 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-8ecbdd67-958c-447c-aa1e-f536dcad4ca8 req-9015b0d4-a0a7-4588-b52a-d51210899f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44eb7c3c-129d-48bc-90eb-ce1c60c10d2e", "tag": "9b53c6b7-b508-47dc-b083-ba526341c773"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:00:59.388775 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:00:59.397836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-8ecbdd67-958c-447c-aa1e-f536dcad4ca8 req-9015b0d4-a0a7-4588-b52a-d51210899f34 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:00:59.398293 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-8ecbdd67-958c-447c-aa1e-f536dcad4ca8 req-9015b0d4-a0a7-4588-b52a-d51210899f34 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:00:59.414439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-8ecbdd67-958c-447c-aa1e-f536dcad4ca8 req-9015b0d4-a0a7-4588-b52a-d51210899f34 service nova] Creating event network-changed:9b53c6b7-b508-47dc-b083-ba526341c773 for instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e on hv-cinder-85093 Jul 26 13:00:59.420163 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-8ecbdd67-958c-447c-aa1e-f536dcad4ca8 req-9015b0d4-a0a7-4588-b52a-d51210899f34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043210 Jul 26 13:00:59.420958 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 536/1064] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:00.492819 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-752cfc1e-1957-47a3-a13a-e34d4aa16773 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1339791851"}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:01:00.493433 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-752cfc1e-1957-47a3-a13a-e34d4aa16773 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:00.500424 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-752cfc1e-1957-47a3-a13a-e34d4aa16773 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:00.500870 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-752cfc1e-1957-47a3-a13a-e34d4aa16773 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:00.501625 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-752cfc1e-1957-47a3-a13a-e34d4aa16773 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:00.502056 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-752cfc1e-1957-47a3-a13a-e34d4aa16773 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:00.636301 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.network.security_group_api [None req-752cfc1e-1957-47a3-a13a-e34d4aa16773 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Adding security group 45c67f8a-b10b-4e80-b40c-398a5fc3c56e to port 9b53c6b7-b508-47dc-b083-ba526341c773 Jul 26 13:01:00.977373 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-752cfc1e-1957-47a3-a13a-e34d4aa16773 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "POST /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/action" status: 202 len: 0 microversion: 2.1 time: 0.488375 Jul 26 13:01:00.979958 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 529/1065] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 13:01:00 2022] POST /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 13:01:00.990379 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-01b633c3-0edf-4db6-ba44-a138669b20af tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:00.991076 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-01b633c3-0edf-4db6-ba44-a138669b20af tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:00.997466 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-01b633c3-0edf-4db6-ba44-a138669b20af tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:00.997836 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-01b633c3-0edf-4db6-ba44-a138669b20af tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:01.003171 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-01b633c3-0edf-4db6-ba44-a138669b20af tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:01.003873 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-01b633c3-0edf-4db6-ba44-a138669b20af tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:01.173346 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-01b633c3-0edf-4db6-ba44-a138669b20af tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:01.181999 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-01b633c3-0edf-4db6-ba44-a138669b20af tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1761 microversion: 2.1 time: 0.196319 Jul 26 13:01:01.182507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 537/1066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:00 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1761 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:01.435816 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-31c94300-9b1b-4f97-a0e4-83c591c8042f req-346c4330-3d6d-4695-9c53-64ad4fb693a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44eb7c3c-129d-48bc-90eb-ce1c60c10d2e", "tag": "9b53c6b7-b508-47dc-b083-ba526341c773"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:01:01.446309 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-31c94300-9b1b-4f97-a0e4-83c591c8042f req-346c4330-3d6d-4695-9c53-64ad4fb693a6 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:01.446753 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-31c94300-9b1b-4f97-a0e4-83c591c8042f req-346c4330-3d6d-4695-9c53-64ad4fb693a6 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:01.458158 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-31c94300-9b1b-4f97-a0e4-83c591c8042f req-346c4330-3d6d-4695-9c53-64ad4fb693a6 service nova] Creating event network-changed:9b53c6b7-b508-47dc-b083-ba526341c773 for instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e on hv-cinder-85093 Jul 26 13:01:01.463259 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-31c94300-9b1b-4f97-a0e4-83c591c8042f req-346c4330-3d6d-4695-9c53-64ad4fb693a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032212 Jul 26 13:01:01.464152 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 530/1067] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:07.145454 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c6a55246-29e7-4ac6-a3c1-1a2218a6490f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:07.146053 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c6a55246-29e7-4ac6-a3c1-1a2218a6490f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:07.152935 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c6a55246-29e7-4ac6-a3c1-1a2218a6490f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:07.153387 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c6a55246-29e7-4ac6-a3c1-1a2218a6490f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:07.154145 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c6a55246-29e7-4ac6-a3c1-1a2218a6490f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:07.154582 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c6a55246-29e7-4ac6-a3c1-1a2218a6490f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:07.177829 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c6a55246-29e7-4ac6-a3c1-1a2218a6490f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/ips" status: 200 len: 145 microversion: 2.1 time: 0.036245 Jul 26 13:01:07.178404 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 538/1068] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Jul 26 13:01:07 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:08.513355 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-d7e90fff-58ec-4999-8991-29269b60fa92 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad41940f-1538-4b3a-947d-eb0b227cbbc3"}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:01:08.515720 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-d7e90fff-58ec-4999-8991-29269b60fa92 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:08.522009 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d7e90fff-58ec-4999-8991-29269b60fa92 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:08.522449 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d7e90fff-58ec-4999-8991-29269b60fa92 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:08.523200 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d7e90fff-58ec-4999-8991-29269b60fa92 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:08.523630 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-d7e90fff-58ec-4999-8991-29269b60fa92 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:08.758809 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-d7e90fff-58ec-4999-8991-29269b60fa92 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "POST /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250440 Jul 26 13:01:08.759693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 531/1069] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 13:01:08 2022] POST /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:16.312453 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-0cdfc8cf-f1f4-4d89-bb2b-34bbc71960f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:16.314580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-0cdfc8cf-f1f4-4d89-bb2b-34bbc71960f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:16.321565 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0cdfc8cf-f1f4-4d89-bb2b-34bbc71960f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:16.322020 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0cdfc8cf-f1f4-4d89-bb2b-34bbc71960f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:16.322793 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0cdfc8cf-f1f4-4d89-bb2b-34bbc71960f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:16.323236 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0cdfc8cf-f1f4-4d89-bb2b-34bbc71960f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:16.353179 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-0cdfc8cf-f1f4-4d89-bb2b-34bbc71960f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044586 Jul 26 13:01:16.353742 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 539/1070] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 13:01:16 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:16.365573 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e1282ba7-3734-476b-8e5e-c51f4cc8beba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:16.366174 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e1282ba7-3734-476b-8e5e-c51f4cc8beba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:16.372668 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e1282ba7-3734-476b-8e5e-c51f4cc8beba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:16.373112 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e1282ba7-3734-476b-8e5e-c51f4cc8beba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:16.373914 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e1282ba7-3734-476b-8e5e-c51f4cc8beba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:16.374289 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e1282ba7-3734-476b-8e5e-c51f4cc8beba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:16.376858 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:16.405854 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e1282ba7-3734-476b-8e5e-c51f4cc8beba tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments/ad41940f-1538-4b3a-947d-eb0b227cbbc3" status: 200 len: 194 microversion: 2.1 time: 0.044693 Jul 26 13:01:16.406434 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 532/1071] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Jul 26 13:01:16 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments/ad41940f-1538-4b3a-947d-eb0b227cbbc3 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:17.753236 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-75014f0e-d7f7-44d0-bc60-d9c3a6e547f8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7952b3f-a1cd-48d9-95ab-79e73286d5c7"}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:01:17.755559 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-75014f0e-d7f7-44d0-bc60-d9c3a6e547f8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:17.762240 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-75014f0e-d7f7-44d0-bc60-d9c3a6e547f8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:17.762695 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-75014f0e-d7f7-44d0-bc60-d9c3a6e547f8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:17.763458 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-75014f0e-d7f7-44d0-bc60-d9c3a6e547f8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:17.763931 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-75014f0e-d7f7-44d0-bc60-d9c3a6e547f8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:18.175746 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-75014f0e-d7f7-44d0-bc60-d9c3a6e547f8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "POST /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.425992 Jul 26 13:01:18.176373 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 540/1072] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Jul 26 13:01:17 2022] POST /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:24.816928 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9a186712-8e83-4641-8801-e6f0417470ba tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:01:24.819373 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-9a186712-8e83-4641-8801-e6f0417470ba tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:24.827397 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9a186712-8e83-4641-8801-e6f0417470ba tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:24.827619 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9a186712-8e83-4641-8801-e6f0417470ba tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:24.828292 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9a186712-8e83-4641-8801-e6f0417470ba tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:24.828862 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9a186712-8e83-4641-8801-e6f0417470ba tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:24.915404 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9a186712-8e83-4641-8801-e6f0417470ba tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "POST /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/action" status: 202 len: 0 microversion: 2.1 time: 0.102693 Jul 26 13:01:24.916084 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 533/1073] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 13:01:24 2022] POST /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 13:01:24.925786 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-adcb7332-e69b-4c97-ae6d-f9b663f1002c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:24.926522 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-adcb7332-e69b-4c97-ae6d-f9b663f1002c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:24.933811 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-adcb7332-e69b-4c97-ae6d-f9b663f1002c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:24.934380 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-adcb7332-e69b-4c97-ae6d-f9b663f1002c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:24.935096 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-adcb7332-e69b-4c97-ae6d-f9b663f1002c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:24.935525 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-adcb7332-e69b-4c97-ae6d-f9b663f1002c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:24.938853 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:25.198605 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-adcb7332-e69b-4c97-ae6d-f9b663f1002c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:25.207625 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-adcb7332-e69b-4c97-ae6d-f9b663f1002c tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1753 microversion: 2.1 time: 0.286287 Jul 26 13:01:25.208480 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 541/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:24 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1753 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:25.719568 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-b969bd48-a93f-4d13-8bc6-9069b728d050 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:25.721604 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-b969bd48-a93f-4d13-8bc6-9069b728d050 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:25.728089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b969bd48-a93f-4d13-8bc6-9069b728d050 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:25.728538 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b969bd48-a93f-4d13-8bc6-9069b728d050 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:25.729300 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b969bd48-a93f-4d13-8bc6-9069b728d050 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:25.729737 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-b969bd48-a93f-4d13-8bc6-9069b728d050 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:25.761446 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-b969bd48-a93f-4d13-8bc6-9069b728d050 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046807 Jul 26 13:01:25.761992 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 534/1075] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 13:01:25 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:25.901953 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-efe129c8-d681-4ed4-bcee-73a4686de833 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:25.902355 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-efe129c8-d681-4ed4-bcee-73a4686de833 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:25.908947 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-efe129c8-d681-4ed4-bcee-73a4686de833 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:25.909391 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-efe129c8-d681-4ed4-bcee-73a4686de833 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:25.910167 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-efe129c8-d681-4ed4-bcee-73a4686de833 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:25.910576 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-efe129c8-d681-4ed4-bcee-73a4686de833 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:25.940194 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-efe129c8-d681-4ed4-bcee-73a4686de833 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments/ad41940f-1538-4b3a-947d-eb0b227cbbc3" status: 200 len: 194 microversion: 2.1 time: 0.042330 Jul 26 13:01:25.940895 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 542/1076] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Jul 26 13:01:25 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments/ad41940f-1538-4b3a-947d-eb0b227cbbc3 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:25.952754 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-1860a3a9-9d47-46c2-b492-f890f71f2aa4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:25.953338 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-1860a3a9-9d47-46c2-b492-f890f71f2aa4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:25.959997 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1860a3a9-9d47-46c2-b492-f890f71f2aa4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:25.960532 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1860a3a9-9d47-46c2-b492-f890f71f2aa4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:25.961401 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1860a3a9-9d47-46c2-b492-f890f71f2aa4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:25.961899 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-1860a3a9-9d47-46c2-b492-f890f71f2aa4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:26.120423 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-1860a3a9-9d47-46c2-b492-f890f71f2aa4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lazy-loading 'services' on Instance uuid 574f5f50-3fa4-4961-a4cc-8991f97f95a6 {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 13:01:26.198875 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-1860a3a9-9d47-46c2-b492-f890f71f2aa4 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments/ad41940f-1538-4b3a-947d-eb0b227cbbc3" status: 202 len: 0 microversion: 2.1 time: 0.250867 Jul 26 13:01:26.199453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 535/1077] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Jul 26 13:01:25 2022] DELETE /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments/ad41940f-1538-4b3a-947d-eb0b227cbbc3 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 13:01:26.229644 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-45323c18-b42c-4ba1-a78b-17f8620146ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:26.230264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-45323c18-b42c-4ba1-a78b-17f8620146ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:26.237051 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-45323c18-b42c-4ba1-a78b-17f8620146ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:26.237316 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-45323c18-b42c-4ba1-a78b-17f8620146ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:26.238083 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-45323c18-b42c-4ba1-a78b-17f8620146ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:26.238750 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-45323c18-b42c-4ba1-a78b-17f8620146ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:26.394002 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-45323c18-b42c-4ba1-a78b-17f8620146ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:26.401871 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-45323c18-b42c-4ba1-a78b-17f8620146ae tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1758 microversion: 2.1 time: 0.176143 Jul 26 13:01:26.402429 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 543/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:26 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 13:01:27.325846 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9e319069-7687-4160-9a44-09fd7c49e02a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:27.327084 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-9e319069-7687-4160-9a44-09fd7c49e02a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:27.329073 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=16 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:27.335187 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9e319069-7687-4160-9a44-09fd7c49e02a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:27.335649 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9e319069-7687-4160-9a44-09fd7c49e02a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:27.336417 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9e319069-7687-4160-9a44-09fd7c49e02a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:27.336848 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9e319069-7687-4160-9a44-09fd7c49e02a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:27.364739 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9e319069-7687-4160-9a44-09fd7c49e02a tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments/d7952b3f-a1cd-48d9-95ab-79e73286d5c7" status: 200 len: 194 microversion: 2.1 time: 0.044071 Jul 26 13:01:27.365314 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 536/1079] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Jul 26 13:01:27 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments/d7952b3f-a1cd-48d9-95ab-79e73286d5c7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:27.376224 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-7df8c93a-24d6-4ce7-a11a-982de08d1af8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:27.376762 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-7df8c93a-24d6-4ce7-a11a-982de08d1af8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:27.383101 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7df8c93a-24d6-4ce7-a11a-982de08d1af8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:27.383546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7df8c93a-24d6-4ce7-a11a-982de08d1af8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:27.384600 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7df8c93a-24d6-4ce7-a11a-982de08d1af8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:27.385047 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-7df8c93a-24d6-4ce7-a11a-982de08d1af8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:27.423715 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-8fc95c21-c8ec-4ccd-b2d9-025fa3aae11d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:27.424329 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-8fc95c21-c8ec-4ccd-b2d9-025fa3aae11d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:27.430813 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8fc95c21-c8ec-4ccd-b2d9-025fa3aae11d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:27.431262 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8fc95c21-c8ec-4ccd-b2d9-025fa3aae11d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:27.432061 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8fc95c21-c8ec-4ccd-b2d9-025fa3aae11d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:27.432514 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-8fc95c21-c8ec-4ccd-b2d9-025fa3aae11d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:27.473259 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-7df8c93a-24d6-4ce7-a11a-982de08d1af8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lazy-loading 'services' on Instance uuid 574f5f50-3fa4-4961-a4cc-8991f97f95a6 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 13:01:27.546735 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-7df8c93a-24d6-4ce7-a11a-982de08d1af8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments/d7952b3f-a1cd-48d9-95ab-79e73286d5c7" status: 202 len: 0 microversion: 2.1 time: 0.174446 Jul 26 13:01:27.547263 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 544/1080] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Jul 26 13:01:27 2022] DELETE /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments/d7952b3f-a1cd-48d9-95ab-79e73286d5c7 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 13:01:27.582558 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-8fc95c21-c8ec-4ccd-b2d9-025fa3aae11d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:27.591937 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-8fc95c21-c8ec-4ccd-b2d9-025fa3aae11d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1758 microversion: 2.1 time: 0.172434 Jul 26 13:01:27.593182 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 537/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:27 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 13:01:28.617910 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e2463a8c-0860-4379-9157-bb500ffbf8e7 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:28.618526 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e2463a8c-0860-4379-9157-bb500ffbf8e7 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:28.625842 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e2463a8c-0860-4379-9157-bb500ffbf8e7 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:28.626301 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e2463a8c-0860-4379-9157-bb500ffbf8e7 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:28.627072 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e2463a8c-0860-4379-9157-bb500ffbf8e7 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:28.627508 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e2463a8c-0860-4379-9157-bb500ffbf8e7 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:28.737304 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-30091c3c-bde6-4ccb-a10b-86ee2215e6f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:28.739537 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-30091c3c-bde6-4ccb-a10b-86ee2215e6f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:28.746062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-30091c3c-bde6-4ccb-a10b-86ee2215e6f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:28.746512 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-30091c3c-bde6-4ccb-a10b-86ee2215e6f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:28.747288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-30091c3c-bde6-4ccb-a10b-86ee2215e6f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:28.747751 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-30091c3c-bde6-4ccb-a10b-86ee2215e6f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:28.774306 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e2463a8c-0860-4379-9157-bb500ffbf8e7 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:28.778291 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-30091c3c-bde6-4ccb-a10b-86ee2215e6f0 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045087 Jul 26 13:01:28.778859 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 538/1082] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 13:01:28 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 13:01:28.782200 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e2463a8c-0860-4379-9157-bb500ffbf8e7 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1758 microversion: 2.1 time: 0.168554 Jul 26 13:01:28.782749 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 545/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:28 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:28.890513 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-be2a4c25-f432-4e02-b898-afaf8cdb3769 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:28.892698 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-be2a4c25-f432-4e02-b898-afaf8cdb3769 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:28.898764 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-be2a4c25-f432-4e02-b898-afaf8cdb3769 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:28.899216 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-be2a4c25-f432-4e02-b898-afaf8cdb3769 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:28.900020 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-be2a4c25-f432-4e02-b898-afaf8cdb3769 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:28.900462 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-be2a4c25-f432-4e02-b898-afaf8cdb3769 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:28.930981 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-be2a4c25-f432-4e02-b898-afaf8cdb3769 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045056 Jul 26 13:01:28.931540 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 539/1084] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 13:01:28 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 13:01:28.992628 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-2a95c8d8-a12e-48b0-ab81-554ae9920e83 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:28.993127 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2a95c8d8-a12e-48b0-ab81-554ae9920e83 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:28.999629 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2a95c8d8-a12e-48b0-ab81-554ae9920e83 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:29.000115 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2a95c8d8-a12e-48b0-ab81-554ae9920e83 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:29.000877 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2a95c8d8-a12e-48b0-ab81-554ae9920e83 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:29.001313 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-2a95c8d8-a12e-48b0-ab81-554ae9920e83 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:29.025276 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-2a95c8d8-a12e-48b0-ab81-554ae9920e83 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Going to try to terminate instance {{(pid=129307) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 13:01:29.101301 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-2a95c8d8-a12e-48b0-ab81-554ae9920e83 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 204 len: 0 microversion: 2.1 time: 0.112133 Jul 26 13:01:29.101870 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 546/1085] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 13:01:28 2022] DELETE /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 13:01:29.111062 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-72d656ed-d4a9-4f67-90dc-3929eb5a51c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:29.111687 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-72d656ed-d4a9-4f67-90dc-3929eb5a51c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:29.117640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-72d656ed-d4a9-4f67-90dc-3929eb5a51c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:29.118084 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-72d656ed-d4a9-4f67-90dc-3929eb5a51c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:29.118834 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-72d656ed-d4a9-4f67-90dc-3929eb5a51c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:29.119278 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-72d656ed-d4a9-4f67-90dc-3929eb5a51c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:29.254631 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-72d656ed-d4a9-4f67-90dc-3929eb5a51c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:29.262274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-72d656ed-d4a9-4f67-90dc-3929eb5a51c8 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 200 len: 1673 microversion: 2.1 time: 0.155668 Jul 26 13:01:29.262829 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 540/1086] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:29 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:29.804263 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-897be5df-1adc-4303-a31a-50cab63277a2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:29.804881 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-897be5df-1adc-4303-a31a-50cab63277a2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:29.811359 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-897be5df-1adc-4303-a31a-50cab63277a2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:29.811841 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-897be5df-1adc-4303-a31a-50cab63277a2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:29.812657 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-897be5df-1adc-4303-a31a-50cab63277a2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:29.813093 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-897be5df-1adc-4303-a31a-50cab63277a2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:29.957064 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-897be5df-1adc-4303-a31a-50cab63277a2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:29.965042 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-897be5df-1adc-4303-a31a-50cab63277a2 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1758 microversion: 2.1 time: 0.165075 Jul 26 13:01:29.965604 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 547/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:29 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:30.283689 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-681b5bbb-06e4-41e9-a975-fd02087e49ef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:30.284302 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-681b5bbb-06e4-41e9-a975-fd02087e49ef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:30.290756 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-681b5bbb-06e4-41e9-a975-fd02087e49ef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:30.291208 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-681b5bbb-06e4-41e9-a975-fd02087e49ef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:30.292009 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-681b5bbb-06e4-41e9-a975-fd02087e49ef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:30.292478 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-681b5bbb-06e4-41e9-a975-fd02087e49ef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:30.421838 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-681b5bbb-06e4-41e9-a975-fd02087e49ef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:30.429352 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-681b5bbb-06e4-41e9-a975-fd02087e49ef tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 200 len: 1673 microversion: 2.1 time: 0.150014 Jul 26 13:01:30.429921 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 541/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:30 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:30.986301 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-0f9e2c18-0e1f-40c4-bd47-7854e311208d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:30.987004 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-0f9e2c18-0e1f-40c4-bd47-7854e311208d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:30.993546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0f9e2c18-0e1f-40c4-bd47-7854e311208d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:30.994004 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0f9e2c18-0e1f-40c4-bd47-7854e311208d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:30.994779 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0f9e2c18-0e1f-40c4-bd47-7854e311208d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:30.995217 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0f9e2c18-0e1f-40c4-bd47-7854e311208d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:31.244466 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-0f9e2c18-0e1f-40c4-bd47-7854e311208d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:31.253663 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-0f9e2c18-0e1f-40c4-bd47-7854e311208d tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1758 microversion: 2.1 time: 0.271189 Jul 26 13:01:31.254580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 548/1089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:30 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1758 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:31.450851 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-7e6f4d77-793f-47f5-90fa-1cbe73fb6907 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:31.451402 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-7e6f4d77-793f-47f5-90fa-1cbe73fb6907 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:31.457910 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7e6f4d77-793f-47f5-90fa-1cbe73fb6907 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:31.458367 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7e6f4d77-793f-47f5-90fa-1cbe73fb6907 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:31.459137 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7e6f4d77-793f-47f5-90fa-1cbe73fb6907 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:31.459574 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-7e6f4d77-793f-47f5-90fa-1cbe73fb6907 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:31.523328 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-7e6f4d77-793f-47f5-90fa-1cbe73fb6907 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd480ea8c18634b88b3248a80422aa798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '429715c1b71244bcbbf9f30190d25823', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:31.532256 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-7e6f4d77-793f-47f5-90fa-1cbe73fb6907 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 200 len: 1606 microversion: 2.1 time: 0.085251 Jul 26 13:01:31.548074 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 542/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:31 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 1606 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:32.064717 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-d8450892-fee1-4d96-bac5-d70dd8df6822 req-22e4eccf-a205-4445-9059-946911c12eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574f5f50-3fa4-4961-a4cc-8991f97f95a6", "name": "network-vif-deleted", "tag": "baf28fd5-13a2-48aa-a2c6-2e4f3dd2ccaf"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:01:32.072476 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:32.080021 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-d8450892-fee1-4d96-bac5-d70dd8df6822 req-22e4eccf-a205-4445-9059-946911c12eea service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:32.080265 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-d8450892-fee1-4d96-bac5-d70dd8df6822 req-22e4eccf-a205-4445-9059-946911c12eea service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:32.095015 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 13:01:32.095412 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-d8450892-fee1-4d96-bac5-d70dd8df6822 req-22e4eccf-a205-4445-9059-946911c12eea service nova] Creating event network-vif-deleted:baf28fd5-13a2-48aa-a2c6-2e4f3dd2ccaf for instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 on hv-cinder-85093 Jul 26 13:01:32.096781 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Tue Jul 26 13:01:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 13:01:32.105271 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-d8450892-fee1-4d96-bac5-d70dd8df6822 req-22e4eccf-a205-4445-9059-946911c12eea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044674 Jul 26 13:01:32.105978 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 549/1091] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 13:01:32.275398 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-223205cf-1b8a-478d-ac11-e63f45cd793f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:32.276052 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-223205cf-1b8a-478d-ac11-e63f45cd793f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:32.282928 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-223205cf-1b8a-478d-ac11-e63f45cd793f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:32.283377 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-223205cf-1b8a-478d-ac11-e63f45cd793f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:32.284215 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-223205cf-1b8a-478d-ac11-e63f45cd793f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:32.284645 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-223205cf-1b8a-478d-ac11-e63f45cd793f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:32.459719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-223205cf-1b8a-478d-ac11-e63f45cd793f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:32.469029 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-223205cf-1b8a-478d-ac11-e63f45cd793f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1758 microversion: 2.1 time: 0.197492 Jul 26 13:01:32.470008 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 543/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:32 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1758 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:32.556778 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4fd265e9-626f-4f9b-98df-f959a02e0aaf tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:32.557580 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4fd265e9-626f-4f9b-98df-f959a02e0aaf tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:32.565667 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4fd265e9-626f-4f9b-98df-f959a02e0aaf tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:32.566195 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4fd265e9-626f-4f9b-98df-f959a02e0aaf tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:32.567031 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4fd265e9-626f-4f9b-98df-f959a02e0aaf tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:32.567539 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4fd265e9-626f-4f9b-98df-f959a02e0aaf tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:32.582054 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-4fd265e9-626f-4f9b-98df-f959a02e0aaf tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] HTTP exception thrown: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4fd265e9-626f-4f9b-98df-f959a02e0aaf tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Request method failure captured: Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 HTTP/1.1 Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-SdIf3Y4TVo9U7UWKHnTjBEufXJrsSFvXW5TQj_ZiGlLFBFsa56pSO2_zeCIWDwIfNkmaCL9cYUFbz3RD2bH5osmaZkzTX7bJfngAJF1a06imq_8or886Sz18xszNAz8Ua2aSM728DAg5lB_RKDy5e67-4983nf8iNpwh17PVanNiU Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 429715c1b71244bcbbf9f30190d25823 Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 13:01:32.583743 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 13:01:32.585303 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/429715c1b71244bcbbf9f30190d25823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_429715c1b71244bcbbf9f30190d25823", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/429715c1b71244bcbbf9f30190d25823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/429715c1b71244bcbbf9f30190d25823"}]}] Jul 26 13:01:32.585303 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:32.585303 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 429715c1b71244bcbbf9f30190d25823 Jul 26 13:01:32.585303 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:32.585303 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeTestJSON-1519996836-project Jul 26 13:01:32.585303 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 13:01:32.585303 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 13:01:32.585303 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: d480ea8c18634b88b3248a80422aa798 Jul 26 13:01:32.585303 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeTestJSON-1519996836-project Jul 26 13:01:32.585303 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 13:01:32.585303 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:32.585303 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '574f5f50-3fa4-4961-a4cc-8991f97f95a6'} Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:01:32.586142 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:32.587585 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:32.588837 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4fd265e9-626f-4f9b-98df-f959a02e0aaf tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Returning 404 to user: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:01:32.588837 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4fd265e9-626f-4f9b-98df-f959a02e0aaf tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 404 len: 111 microversion: 2.1 time: 0.032691 Jul 26 13:01:32.588837 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 550/1093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:32 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 13:01:32.593959 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-03d9f014-df83-4d32-98bd-c9597b3d46c1 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '.version_select at 0x7f65f52cb430>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:32.614235 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-03d9f014-df83-4d32-98bd-c9597b3d46c1 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1305006948" status: 202 len: 0 microversion: 2.1 time: 0.023940 Jul 26 13:01:32.614751 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 544/1094] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Jul 26 13:01:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1305006948 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 13:01:33.493604 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4f8c885f-0ccd-4b22-89f7-d46417f0768b tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:33.494251 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4f8c885f-0ccd-4b22-89f7-d46417f0768b tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:33.500869 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4f8c885f-0ccd-4b22-89f7-d46417f0768b tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:33.501348 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4f8c885f-0ccd-4b22-89f7-d46417f0768b tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:33.502124 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4f8c885f-0ccd-4b22-89f7-d46417f0768b tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:33.502586 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4f8c885f-0ccd-4b22-89f7-d46417f0768b tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:33.653887 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4f8c885f-0ccd-4b22-89f7-d46417f0768b tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:33.664802 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4f8c885f-0ccd-4b22-89f7-d46417f0768b tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1758 microversion: 2.1 time: 0.177737 Jul 26 13:01:33.665375 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 551/1095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:33 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:34.686094 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-75057274-5137-4c42-91e7-9b10f3573eb9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:34.686759 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-75057274-5137-4c42-91e7-9b10f3573eb9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:34.692737 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-75057274-5137-4c42-91e7-9b10f3573eb9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:34.693182 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-75057274-5137-4c42-91e7-9b10f3573eb9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:34.693985 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-75057274-5137-4c42-91e7-9b10f3573eb9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:34.694415 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-75057274-5137-4c42-91e7-9b10f3573eb9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:34.838895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-75057274-5137-4c42-91e7-9b10f3573eb9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:34.847560 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-75057274-5137-4c42-91e7-9b10f3573eb9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1758 microversion: 2.1 time: 0.165811 Jul 26 13:01:34.848230 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 545/1096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:34 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:35.505752 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c0cec2eb-1eac-42e2-84cb-73829872cc5e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:35.506246 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c0cec2eb-1eac-42e2-84cb-73829872cc5e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:35.512955 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c0cec2eb-1eac-42e2-84cb-73829872cc5e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:35.513406 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c0cec2eb-1eac-42e2-84cb-73829872cc5e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:35.514160 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c0cec2eb-1eac-42e2-84cb-73829872cc5e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:35.514592 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c0cec2eb-1eac-42e2-84cb-73829872cc5e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:35.528131 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-c0cec2eb-1eac-42e2-84cb-73829872cc5e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] HTTP exception thrown: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c0cec2eb-1eac-42e2-84cb-73829872cc5e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Request method failure captured: Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: DELETE /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 HTTP/1.1 Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-SdIf3Y4TVo9U7UWKHnTjBEufXJrsSFvXW5TQj_ZiGlLFBFsa56pSO2_zeCIWDwIfNkmaCL9cYUFbz3RD2bH5osmaZkzTX7bJfngAJF1a06imq_8or886Sz18xszNAz8Ua2aSM728DAg5lB_RKDy5e67-4983nf8iNpwh17PVanNiU Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 429715c1b71244bcbbf9f30190d25823 Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 13:01:35.530180 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 13:01:35.531878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/429715c1b71244bcbbf9f30190d25823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_429715c1b71244bcbbf9f30190d25823", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/429715c1b71244bcbbf9f30190d25823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/429715c1b71244bcbbf9f30190d25823"}]}] Jul 26 13:01:35.531878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:35.531878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 429715c1b71244bcbbf9f30190d25823 Jul 26 13:01:35.531878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:35.531878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeTestJSON-1519996836-project Jul 26 13:01:35.531878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 13:01:35.531878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 13:01:35.531878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: d480ea8c18634b88b3248a80422aa798 Jul 26 13:01:35.531878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeTestJSON-1519996836-project Jul 26 13:01:35.531878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 13:01:35.531878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:35.531878 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '574f5f50-3fa4-4961-a4cc-8991f97f95a6'} Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:01:35.532863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:35.534319 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:35.535863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c0cec2eb-1eac-42e2-84cb-73829872cc5e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Returning 404 to user: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:01:35.535863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c0cec2eb-1eac-42e2-84cb-73829872cc5e tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 404 len: 111 microversion: 2.1 time: 0.029630 Jul 26 13:01:35.535863 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 552/1097] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 13:01:35 2022] DELETE /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 13:01:35.541079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-925e62e6-c893-44b7-b4a5-fece6cd99e6f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:35.541694 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-925e62e6-c893-44b7-b4a5-fece6cd99e6f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 574f5f50-3fa4-4961-a4cc-8991f97f95a6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:35.552356 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-925e62e6-c893-44b7-b4a5-fece6cd99e6f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:35.552815 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-925e62e6-c893-44b7-b4a5-fece6cd99e6f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:35.553729 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-925e62e6-c893-44b7-b4a5-fece6cd99e6f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:35.554207 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-925e62e6-c893-44b7-b4a5-fece6cd99e6f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:35.570286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-925e62e6-c893-44b7-b4a5-fece6cd99e6f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] HTTP exception thrown: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-925e62e6-c893-44b7-b4a5-fece6cd99e6f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Request method failure captured: Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 HTTP/1.1 Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-SdIf3Y4TVo9U7UWKHnTjBEufXJrsSFvXW5TQj_ZiGlLFBFsa56pSO2_zeCIWDwIfNkmaCL9cYUFbz3RD2bH5osmaZkzTX7bJfngAJF1a06imq_8or886Sz18xszNAz8Ua2aSM728DAg5lB_RKDy5e67-4983nf8iNpwh17PVanNiU Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: 429715c1b71244bcbbf9f30190d25823 Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 13:01:35.573080 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 13:01:35.574564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/429715c1b71244bcbbf9f30190d25823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_429715c1b71244bcbbf9f30190d25823", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/429715c1b71244bcbbf9f30190d25823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/429715c1b71244bcbbf9f30190d25823"}]}] Jul 26 13:01:35.574564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:35.574564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: 429715c1b71244bcbbf9f30190d25823 Jul 26 13:01:35.574564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:35.574564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-AttachVolumeTestJSON-1519996836-project Jul 26 13:01:35.574564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 13:01:35.574564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 13:01:35.574564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: d480ea8c18634b88b3248a80422aa798 Jul 26 13:01:35.574564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-AttachVolumeTestJSON-1519996836-project Jul 26 13:01:35.574564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 13:01:35.574564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:35.574564 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '574f5f50-3fa4-4961-a4cc-8991f97f95a6'} Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:01:35.575845 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. Jul 26 13:01:35.577123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:01:35.578271 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-925e62e6-c893-44b7-b4a5-fece6cd99e6f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Returning 404 to user: Instance 574f5f50-3fa4-4961-a4cc-8991f97f95a6 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:01:35.578271 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-925e62e6-c893-44b7-b4a5-fece6cd99e6f tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6" status: 404 len: 111 microversion: 2.1 time: 0.037547 Jul 26 13:01:35.578271 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 546/1098] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:35 2022] GET /compute/v2.1/servers/574f5f50-3fa4-4961-a4cc-8991f97f95a6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 13:01:35.869563 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d7d1566e-b273-44de-8795-e5d3cf29c541 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:35.870104 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-d7d1566e-b273-44de-8795-e5d3cf29c541 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:35.876556 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d7d1566e-b273-44de-8795-e5d3cf29c541 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:35.877091 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d7d1566e-b273-44de-8795-e5d3cf29c541 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:35.877876 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d7d1566e-b273-44de-8795-e5d3cf29c541 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:35.878555 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-d7d1566e-b273-44de-8795-e5d3cf29c541 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:36.027547 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-d7d1566e-b273-44de-8795-e5d3cf29c541 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:36.035707 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d7d1566e-b273-44de-8795-e5d3cf29c541 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1758 microversion: 2.1 time: 0.170291 Jul 26 13:01:36.036274 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 553/1099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:35 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:36.725355 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-16c227b6-bc9b-449b-9fe8-4536d2340e36 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:36.725957 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-16c227b6-bc9b-449b-9fe8-4536d2340e36 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:36.733806 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-16c227b6-bc9b-449b-9fe8-4536d2340e36 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:36.734256 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-16c227b6-bc9b-449b-9fe8-4536d2340e36 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:36.735032 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-16c227b6-bc9b-449b-9fe8-4536d2340e36 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:36.735462 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-16c227b6-bc9b-449b-9fe8-4536d2340e36 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:36.749439 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-16c227b6-bc9b-449b-9fe8-4536d2340e36 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] HTTP exception thrown: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-16c227b6-bc9b-449b-9fe8-4536d2340e36 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Request method failure captured: Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: DELETE /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 HTTP/1.1 Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-SdIf3Y4TVo9U7UWKHnTjBEufXJrsSFvXW5TQj_ZiGlLFBFsa56pSO2_zeCIWDwIfNkmaCL9cYUFbz3RD2bH5osmaZkzTX7bJfngAJF1a06imq_8or886Sz18xszNAz8Ua2aSM728DAg5lB_RKDy5e67-4983nf8iNpwh17PVanNiU Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: 429715c1b71244bcbbf9f30190d25823 Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 13:01:36.750974 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 13:01:36.752652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/429715c1b71244bcbbf9f30190d25823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_429715c1b71244bcbbf9f30190d25823", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/429715c1b71244bcbbf9f30190d25823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/429715c1b71244bcbbf9f30190d25823"}]}] Jul 26 13:01:36.752652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:36.752652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: 429715c1b71244bcbbf9f30190d25823 Jul 26 13:01:36.752652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:36.752652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-AttachVolumeTestJSON-1519996836-project Jul 26 13:01:36.752652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 13:01:36.752652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 13:01:36.752652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: d480ea8c18634b88b3248a80422aa798 Jul 26 13:01:36.752652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-AttachVolumeTestJSON-1519996836-project Jul 26 13:01:36.752652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 13:01:36.752652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:01:36.752652 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '5a1a3713-8bde-42c4-ad34-76974193ab34'} Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:01:36.753579 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:01:36.755079 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:01:36.756624 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-16c227b6-bc9b-449b-9fe8-4536d2340e36 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Returning 404 to user: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:01:36.756624 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-16c227b6-bc9b-449b-9fe8-4536d2340e36 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 404 len: 111 microversion: 2.1 time: 0.030929 Jul 26 13:01:36.756624 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 547/1100] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 13:01:36 2022] DELETE /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 13:01:36.761064 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f128748b-da6c-478b-8dbb-36f5d6e05e87 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:36.761672 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-f128748b-da6c-478b-8dbb-36f5d6e05e87 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] [instance: 5a1a3713-8bde-42c4-ad34-76974193ab34] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:36.768659 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f128748b-da6c-478b-8dbb-36f5d6e05e87 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:36.769113 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f128748b-da6c-478b-8dbb-36f5d6e05e87 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:36.769911 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f128748b-da6c-478b-8dbb-36f5d6e05e87 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:36.770378 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-f128748b-da6c-478b-8dbb-36f5d6e05e87 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:36.784183 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-f128748b-da6c-478b-8dbb-36f5d6e05e87 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] HTTP exception thrown: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f128748b-da6c-478b-8dbb-36f5d6e05e87 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Request method failure captured: Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 HTTP/1.1 Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-SdIf3Y4TVo9U7UWKHnTjBEufXJrsSFvXW5TQj_ZiGlLFBFsa56pSO2_zeCIWDwIfNkmaCL9cYUFbz3RD2bH5osmaZkzTX7bJfngAJF1a06imq_8or886Sz18xszNAz8Ua2aSM728DAg5lB_RKDy5e67-4983nf8iNpwh17PVanNiU Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 429715c1b71244bcbbf9f30190d25823 Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 13:01:36.785694 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 13:01:36.787305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/429715c1b71244bcbbf9f30190d25823"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_429715c1b71244bcbbf9f30190d25823", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/429715c1b71244bcbbf9f30190d25823"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/429715c1b71244bcbbf9f30190d25823"}]}] Jul 26 13:01:36.787305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:36.787305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 429715c1b71244bcbbf9f30190d25823 Jul 26 13:01:36.787305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1519996836 Jul 26 13:01:36.787305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-AttachVolumeTestJSON-1519996836-project Jul 26 13:01:36.787305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 13:01:36.787305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 13:01:36.787305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: d480ea8c18634b88b3248a80422aa798 Jul 26 13:01:36.787305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-AttachVolumeTestJSON-1519996836-project Jul 26 13:01:36.787305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: > Jul 26 13:01:36.787305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:01:36.787305 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '5a1a3713-8bde-42c4-ad34-76974193ab34'} Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:01:36.788187 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. Jul 26 13:01:36.789485 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:36.790606 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-f128748b-da6c-478b-8dbb-36f5d6e05e87 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] Returning 404 to user: Instance 5a1a3713-8bde-42c4-ad34-76974193ab34 could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:01:36.790606 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-f128748b-da6c-478b-8dbb-36f5d6e05e87 tempest-AttachVolumeTestJSON-1519996836 tempest-AttachVolumeTestJSON-1519996836-project] 10.222.0.20 "GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34" status: 404 len: 111 microversion: 2.1 time: 0.030082 Jul 26 13:01:36.790606 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 554/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:36 2022] GET /compute/v2.1/servers/5a1a3713-8bde-42c4-ad34-76974193ab34 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 13:01:37.055814 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-a859ecd2-1892-419d-b1e7-d4b8648b7bd8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:37.056736 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-a859ecd2-1892-419d-b1e7-d4b8648b7bd8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:37.063313 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a859ecd2-1892-419d-b1e7-d4b8648b7bd8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:37.064088 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a859ecd2-1892-419d-b1e7-d4b8648b7bd8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:37.065082 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a859ecd2-1892-419d-b1e7-d4b8648b7bd8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:37.065804 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-a859ecd2-1892-419d-b1e7-d4b8648b7bd8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:37.316341 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-a859ecd2-1892-419d-b1e7-d4b8648b7bd8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:37.324409 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-a859ecd2-1892-419d-b1e7-d4b8648b7bd8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1761 microversion: 2.1 time: 0.272497 Jul 26 13:01:37.325010 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 548/1102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:37 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1761 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:41.213943 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-8c242ce5-8d18-4576-abac-3258430137c6 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] Action: 'create', calling method: .version_select at 0x7f65f53f8af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1975219007", "metadata": {"Type": "work"}}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:01:41.501125 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-8c242ce5-8d18-4576-abac-3258430137c6 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.405351 Jul 26 13:01:41.501881 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 555/1103] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Jul 26 13:01:41 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 407 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 13:01:41.514547 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-6081ce0b-48cf-441d-86f3-b094443e7cc2 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] Calling method '.version_select at 0x7f65f52c3040>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:41.565017 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-6081ce0b-48cf-441d-86f3-b094443e7cc2 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/0a7f05a7-5c74-4221-8659-93f7edeafbcc" status: 200 len: 353 microversion: 2.1 time: 0.054508 Jul 26 13:01:41.565583 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 549/1104] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 13:01:41 2022] GET /compute/v2.1/os-volumes/0a7f05a7-5c74-4221-8659-93f7edeafbcc => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:42.579756 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-9629309f-8bec-4897-8ab2-d38e026aec60 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] Calling method '.version_select at 0x7f65f5418820>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:42.627760 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-9629309f-8bec-4897-8ab2-d38e026aec60 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/0a7f05a7-5c74-4221-8659-93f7edeafbcc" status: 200 len: 354 microversion: 2.1 time: 0.052714 Jul 26 13:01:42.628340 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 556/1105] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 13:01:42 2022] GET /compute/v2.1/os-volumes/0a7f05a7-5c74-4221-8659-93f7edeafbcc => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:42.641429 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-301078a6-c967-4396-81eb-4691664dbb88 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] Calling method '.version_select at 0x7f65f52cbd30>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:42.688198 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-301078a6-c967-4396-81eb-4691664dbb88 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/0a7f05a7-5c74-4221-8659-93f7edeafbcc" status: 200 len: 354 microversion: 2.1 time: 0.051073 Jul 26 13:01:42.688762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 550/1106] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 13:01:42 2022] GET /compute/v2.1/os-volumes/0a7f05a7-5c74-4221-8659-93f7edeafbcc => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:42.705825 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6b75bf29-78b4-433f-ac3c-08019484985f tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] Calling method '.version_select at 0x7f65f53f8700>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:42.767588 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-6b75bf29-78b4-433f-ac3c-08019484985f tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/0a7f05a7-5c74-4221-8659-93f7edeafbcc" status: 202 len: 0 microversion: 2.1 time: 0.065424 Jul 26 13:01:42.768518 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 557/1107] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Jul 26 13:01:42 2022] DELETE /compute/v2.1/os-volumes/0a7f05a7-5c74-4221-8659-93f7edeafbcc => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 13:01:42.777330 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-5550c0de-66b5-4ba7-a581-70d2894e5d91 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] Calling method '.version_select at 0x7f65f51e3430>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:42.823563 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-5550c0de-66b5-4ba7-a581-70d2894e5d91 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/0a7f05a7-5c74-4221-8659-93f7edeafbcc" status: 200 len: 353 microversion: 2.1 time: 0.049971 Jul 26 13:01:42.824172 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 551/1108] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 13:01:42 2022] GET /compute/v2.1/os-volumes/0a7f05a7-5c74-4221-8659-93f7edeafbcc => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:01:43.837904 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6a8516fd-ff13-429d-b1ce-2ac41335bf71 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] Calling method '.version_select at 0x7f65f5285280>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:43.864952 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.wsgi [None req-6a8516fd-ff13-429d-b1ce-2ac41335bf71 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] HTTP exception thrown: Volume 0a7f05a7-5c74-4221-8659-93f7edeafbcc could not be found. Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6a8516fd-ff13-429d-b1ce-2ac41335bf71 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] Request method failure captured: Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: request: GET /compute/v2.1/os-volumes/0a7f05a7-5c74-4221-8659-93f7edeafbcc HTTP/1.1 Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept: application/json Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Accept-Encoding: identity Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Connection: close Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Length: 0 Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Content-Type: application/json Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Host: 10.222.0.20 Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Openstack-System-Scope: None Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: User-Agent: python-urllib3/1.26.10 Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Auth-Token: gAAAAABi3-W11rmTkauSaNAmXotNFT8KjQkL8drqj95MsWKL6NG9BwD-SSEeLj28ALEgKtWbIbf-cw2kShzR_mFuigFK-RdpjRPTBzgNg_2N5pz8ig3BR8oOuVroVvwmuwO92P5WVkJ7it1B8pK2qThtWeUtqSnVI3Fh-Za7HVWXwfLdOghFqxQ Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Id: None Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Domain-Name: None Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Identity-Status: Confirmed Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Is-Admin-Project: True Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Id: default Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Domain-Name: Default Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Id: 2ab311ac1d334258ae30db35c83fcc2f Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Project-Name: tempest-VolumesGetTestJSON-1706802664 Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Role: member,reader Jul 26 13:01:43.866896 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Roles: member,reader Jul 26 13:01:43.868546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ab311ac1d334258ae30db35c83fcc2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ab311ac1d334258ae30db35c83fcc2f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ab311ac1d334258ae30db35c83fcc2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ab311ac1d334258ae30db35c83fcc2f"}]}] Jul 26 13:01:43.868546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant: tempest-VolumesGetTestJSON-1706802664 Jul 26 13:01:43.868546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Id: 2ab311ac1d334258ae30db35c83fcc2f Jul 26 13:01:43.868546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-Tenant-Name: tempest-VolumesGetTestJSON-1706802664 Jul 26 13:01:43.868546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User: tempest-VolumesGetTestJSON-1706802664-project Jul 26 13:01:43.868546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Id: default Jul 26 13:01:43.868546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Domain-Name: Default Jul 26 13:01:43.868546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Id: b02926e72e3e4d7d959a24657de527d1 Jul 26 13:01:43.868546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: X-User-Name: tempest-VolumesGetTestJSON-1706802664-project Jul 26 13:01:43.868546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: method: Jul 26 13:01:43.868546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: exception: Volume 0a7f05a7-5c74-4221-8659-93f7edeafbcc could not be found. Jul 26 13:01:43.868546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: action_args: {'id': '0a7f05a7-5c74-4221-8659-93f7edeafbcc'} Jul 26 13:01:43.868546 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0a7f05a7-5c74-4221-8659-93f7edeafbcc could not be found. (HTTP 404) (Request-ID: req-cf1a7d8c-ee19-439f-b1fc-d6b7e1475e00) Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:01:43.869620 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 13:01:43.871068 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0a7f05a7-5c74-4221-8659-93f7edeafbcc could not be found. Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 13:01:43.872595 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0a7f05a7-5c74-4221-8659-93f7edeafbcc could not be found. Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0a7f05a7-5c74-4221-8659-93f7edeafbcc could not be found. Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: ERROR nova.api.openstack.wsgi Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-6a8516fd-ff13-429d-b1ce-2ac41335bf71 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] Returning 404 to user: Volume 0a7f05a7-5c74-4221-8659-93f7edeafbcc could not be found. {{(pid=129307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-6a8516fd-ff13-429d-b1ce-2ac41335bf71 tempest-VolumesGetTestJSON-1706802664 tempest-VolumesGetTestJSON-1706802664-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/0a7f05a7-5c74-4221-8659-93f7edeafbcc" status: 404 len: 109 microversion: 2.1 time: 0.034964 Jul 26 13:01:43.874632 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 558/1109] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Jul 26 13:01:43 2022] GET /compute/v2.1/os-volumes/0a7f05a7-5c74-4221-8659-93f7edeafbcc => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 13:01:58.509255 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_api:SELECT=11 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:58.510214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e4f94207-98d8-422d-804e-0ddbf1afb219 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:58.510214 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e4f94207-98d8-422d-804e-0ddbf1afb219 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:58.510814 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG dbcounter [-] [129307] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:58.517691 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:58.518432 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG dbcounter [-] [129308] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129308) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 13:01:58.534523 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e4f94207-98d8-422d-804e-0ddbf1afb219 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:58.534642 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e4f94207-98d8-422d-804e-0ddbf1afb219 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:58.535348 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e4f94207-98d8-422d-804e-0ddbf1afb219 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:58.535812 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e4f94207-98d8-422d-804e-0ddbf1afb219 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:58.580504 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e4f94207-98d8-422d-804e-0ddbf1afb219 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Going to try to terminate instance {{(pid=129308) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 13:01:58.670069 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e4f94207-98d8-422d-804e-0ddbf1afb219 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 204 len: 0 microversion: 2.1 time: 0.165211 Jul 26 13:01:58.672071 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 552/1110] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 13:01:58 2022] DELETE /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 13:01:58.681649 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-702ee422-4418-4f81-aad3-0dc8e42ac154 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:58.682664 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-702ee422-4418-4f81-aad3-0dc8e42ac154 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:58.689748 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-702ee422-4418-4f81-aad3-0dc8e42ac154 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:58.690195 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-702ee422-4418-4f81-aad3-0dc8e42ac154 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:58.690976 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-702ee422-4418-4f81-aad3-0dc8e42ac154 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:58.691443 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-702ee422-4418-4f81-aad3-0dc8e42ac154 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:58.693684 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [req-5629dd0b-0eda-4132-8e7a-9d27350ce92a req-20dc4560-7123-4915-a939-e4a64d04d937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ddf07f-628a-4aca-8e71-e2ad95e160a2", "tag": "56458652-0240-4463-b181-f1a431b8e38c"}]} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:01:58.707473 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-5629dd0b-0eda-4132-8e7a-9d27350ce92a req-20dc4560-7123-4915-a939-e4a64d04d937 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:58.708331 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [req-5629dd0b-0eda-4132-8e7a-9d27350ce92a req-20dc4560-7123-4915-a939-e4a64d04d937 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:58.722055 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.compute.server_external_events [req-5629dd0b-0eda-4132-8e7a-9d27350ce92a req-20dc4560-7123-4915-a939-e4a64d04d937 service nova] Creating event network-changed:56458652-0240-4463-b181-f1a431b8e38c for instance e0ddf07f-628a-4aca-8e71-e2ad95e160a2 on hv-cinder-85093 Jul 26 13:01:58.727376 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [req-5629dd0b-0eda-4132-8e7a-9d27350ce92a req-20dc4560-7123-4915-a939-e4a64d04d937 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219862 Jul 26 13:01:58.729841 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 559/1111] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 13:01:58.836874 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-702ee422-4418-4f81-aad3-0dc8e42ac154 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:01:58.845251 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-702ee422-4418-4f81-aad3-0dc8e42ac154 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1577 microversion: 2.1 time: 0.168261 Jul 26 13:01:58.845813 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 553/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:58 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:01:59.868454 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-c298d667-a95a-416d-b3bf-e457b2520ac8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:01:59.869909 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-c298d667-a95a-416d-b3bf-e457b2520ac8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:01:59.877927 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c298d667-a95a-416d-b3bf-e457b2520ac8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:59.878435 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c298d667-a95a-416d-b3bf-e457b2520ac8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:01:59.879274 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c298d667-a95a-416d-b3bf-e457b2520ac8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:01:59.879745 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-c298d667-a95a-416d-b3bf-e457b2520ac8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:00.115674 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-c298d667-a95a-416d-b3bf-e457b2520ac8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:02:00.124498 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-c298d667-a95a-416d-b3bf-e457b2520ac8 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1577 microversion: 2.1 time: 0.260652 Jul 26 13:02:00.125289 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 560/1113] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:01:59 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1577 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:02:01.103096 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-3871d3c4-041c-4d17-a055-d55f8c729993 req-ff06d917-412a-48b2-b6ec-1fd519df6bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ddf07f-628a-4aca-8e71-e2ad95e160a2", "name": "network-vif-deleted", "tag": "56458652-0240-4463-b181-f1a431b8e38c"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:02:01.113504 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-3871d3c4-041c-4d17-a055-d55f8c729993 req-ff06d917-412a-48b2-b6ec-1fd519df6bd1 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:01.114233 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-3871d3c4-041c-4d17-a055-d55f8c729993 req-ff06d917-412a-48b2-b6ec-1fd519df6bd1 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:01.127107 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-3871d3c4-041c-4d17-a055-d55f8c729993 req-ff06d917-412a-48b2-b6ec-1fd519df6bd1 service nova] Creating event network-vif-deleted:56458652-0240-4463-b181-f1a431b8e38c for instance e0ddf07f-628a-4aca-8e71-e2ad95e160a2 on hv-cinder-85093 Jul 26 13:02:01.132059 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-3871d3c4-041c-4d17-a055-d55f8c729993 req-ff06d917-412a-48b2-b6ec-1fd519df6bd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268121 Jul 26 13:02:01.132690 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 554/1114] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:02:01.146287 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-e343d2f4-3022-4e9e-9eae-81973086e120 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:01.146893 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-e343d2f4-3022-4e9e-9eae-81973086e120 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:01.156114 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e343d2f4-3022-4e9e-9eae-81973086e120 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:01.156608 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e343d2f4-3022-4e9e-9eae-81973086e120 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:01.157493 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e343d2f4-3022-4e9e-9eae-81973086e120 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:01.158542 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-e343d2f4-3022-4e9e-9eae-81973086e120 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:01.241369 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-e343d2f4-3022-4e9e-9eae-81973086e120 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:02:01.250592 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-e343d2f4-3022-4e9e-9eae-81973086e120 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 200 len: 1225 microversion: 2.1 time: 0.108316 Jul 26 13:02:01.251477 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 561/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:02:01 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:02:02.273565 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-dde9bb8e-3b50-47cb-8a36-52564b6d46f4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:02.274317 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-dde9bb8e-3b50-47cb-8a36-52564b6d46f4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: e0ddf07f-628a-4aca-8e71-e2ad95e160a2] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:02.281254 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dde9bb8e-3b50-47cb-8a36-52564b6d46f4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:02.281705 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dde9bb8e-3b50-47cb-8a36-52564b6d46f4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:02.282475 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dde9bb8e-3b50-47cb-8a36-52564b6d46f4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:02.282911 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-dde9bb8e-3b50-47cb-8a36-52564b6d46f4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:02.297063 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-dde9bb8e-3b50-47cb-8a36-52564b6d46f4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] HTTP exception thrown: Instance e0ddf07f-628a-4aca-8e71-e2ad95e160a2 could not be found. Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-dde9bb8e-3b50-47cb-8a36-52564b6d46f4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Request method failure captured: Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 HTTP/1.1 Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-P6I4oZJTGyBxyXC8K7pa2GPTfIJf6EOGmVLtC59ScPVeMnVd7rnTVHCojwupIXZrf2bh_e2EqqpfganxExWxX_GLRgJYV2f7mYDtQh9nCrZd0yfcEhBeZKdqmQITp2eixdDBPg-Y0vW3RkVC902oxYQPTGR0qCwCaspEZOyZrnaCE Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: a2522985c6df452dabe2010e5f6bed35 Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-TestVolumeBootPattern-763444378 Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 13:02:02.298719 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 13:02:02.300548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2522985c6df452dabe2010e5f6bed35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2522985c6df452dabe2010e5f6bed35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2522985c6df452dabe2010e5f6bed35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2522985c6df452dabe2010e5f6bed35"}]}] Jul 26 13:02:02.300548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-TestVolumeBootPattern-763444378 Jul 26 13:02:02.300548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: a2522985c6df452dabe2010e5f6bed35 Jul 26 13:02:02.300548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-TestVolumeBootPattern-763444378 Jul 26 13:02:02.300548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-TestVolumeBootPattern-763444378-project Jul 26 13:02:02.300548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 13:02:02.300548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 13:02:02.300548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 94efba410653451da2e9977d746633f6 Jul 26 13:02:02.300548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-TestVolumeBootPattern-763444378-project Jul 26 13:02:02.300548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 13:02:02.300548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance e0ddf07f-628a-4aca-8e71-e2ad95e160a2 could not be found. Jul 26 13:02:02.300548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': 'e0ddf07f-628a-4aca-8e71-e2ad95e160a2'} Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ddf07f-628a-4aca-8e71-e2ad95e160a2 could not be found. Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:02:02.301708 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ddf07f-628a-4aca-8e71-e2ad95e160a2 could not be found. Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ddf07f-628a-4aca-8e71-e2ad95e160a2 could not be found. Jul 26 13:02:02.303274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:02.305118 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-dde9bb8e-3b50-47cb-8a36-52564b6d46f4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Returning 404 to user: Instance e0ddf07f-628a-4aca-8e71-e2ad95e160a2 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:02:02.305118 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-dde9bb8e-3b50-47cb-8a36-52564b6d46f4 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2" status: 404 len: 111 microversion: 2.1 time: 0.031497 Jul 26 13:02:02.305118 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 555/1116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:02:02 2022] GET /compute/v2.1/servers/e0ddf07f-628a-4aca-8e71-e2ad95e160a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 13:02:05.710134 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-17fd79df-f2d3-46d7-81eb-e0aa44d02272 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:05.710652 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-17fd79df-f2d3-46d7-81eb-e0aa44d02272 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:05.720233 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-e8035032-e5e5-42f2-b4b7-1bffb29feb7f req-6586c6d9-ad2b-4ea4-9a86-f1f3283c5f5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d1d6a8-9517-49ed-b0eb-d90086cd1783", "tag": "5d30f17c-376a-40af-aea4-819f4cd01ebc"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:02:05.729443 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-17fd79df-f2d3-46d7-81eb-e0aa44d02272 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:05.729903 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-17fd79df-f2d3-46d7-81eb-e0aa44d02272 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:05.730680 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-17fd79df-f2d3-46d7-81eb-e0aa44d02272 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:05.731118 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-17fd79df-f2d3-46d7-81eb-e0aa44d02272 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:05.732026 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-e8035032-e5e5-42f2-b4b7-1bffb29feb7f req-6586c6d9-ad2b-4ea4-9a86-f1f3283c5f5d service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:05.732762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-e8035032-e5e5-42f2-b4b7-1bffb29feb7f req-6586c6d9-ad2b-4ea4-9a86-f1f3283c5f5d service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:05.757109 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-e8035032-e5e5-42f2-b4b7-1bffb29feb7f req-6586c6d9-ad2b-4ea4-9a86-f1f3283c5f5d service nova] Creating event network-changed:5d30f17c-376a-40af-aea4-819f4cd01ebc for instance 62d1d6a8-9517-49ed-b0eb-d90086cd1783 on hv-cinder-85093 Jul 26 13:02:05.766782 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-e8035032-e5e5-42f2-b4b7-1bffb29feb7f req-6586c6d9-ad2b-4ea4-9a86-f1f3283c5f5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050587 Jul 26 13:02:05.768489 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 556/1117] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:02:05.786131 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-17fd79df-f2d3-46d7-81eb-e0aa44d02272 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Going to try to terminate instance {{(pid=129307) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 13:02:05.888593 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-17fd79df-f2d3-46d7-81eb-e0aa44d02272 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 204 len: 0 microversion: 2.1 time: 0.181005 Jul 26 13:02:05.894001 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 562/1118] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 13:02:05 2022] DELETE /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 13:02:05.899777 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-e335acb7-5cb7-4580-b272-7b49a2c9195f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:05.900986 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-e335acb7-5cb7-4580-b272-7b49a2c9195f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:05.913171 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e335acb7-5cb7-4580-b272-7b49a2c9195f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:05.913750 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e335acb7-5cb7-4580-b272-7b49a2c9195f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:05.914547 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e335acb7-5cb7-4580-b272-7b49a2c9195f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:05.917339 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-e335acb7-5cb7-4580-b272-7b49a2c9195f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:06.085238 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-e335acb7-5cb7-4580-b272-7b49a2c9195f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:02:06.095224 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-e335acb7-5cb7-4580-b272-7b49a2c9195f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1577 microversion: 2.1 time: 0.200363 Jul 26 13:02:06.096126 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 557/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:02:05 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1577 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 13:02:07.117687 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ce2ccb00-8d9c-4c5c-926c-f1977245d7d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:07.118387 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ce2ccb00-8d9c-4c5c-926c-f1977245d7d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:07.125635 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ce2ccb00-8d9c-4c5c-926c-f1977245d7d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:07.126084 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ce2ccb00-8d9c-4c5c-926c-f1977245d7d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:07.126859 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ce2ccb00-8d9c-4c5c-926c-f1977245d7d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:07.127545 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ce2ccb00-8d9c-4c5c-926c-f1977245d7d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:07.354885 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ce2ccb00-8d9c-4c5c-926c-f1977245d7d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:02:07.364371 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ce2ccb00-8d9c-4c5c-926c-f1977245d7d1 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1577 microversion: 2.1 time: 0.250776 Jul 26 13:02:07.365918 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 563/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:02:07 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1577 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:02:07.928454 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-a9ce618d-8f2e-4e63-bbe4-a40a2b15e454 req-7e641b31-4ea3-4082-aa11-288827902dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d1d6a8-9517-49ed-b0eb-d90086cd1783", "name": "network-vif-deleted", "tag": "5d30f17c-376a-40af-aea4-819f4cd01ebc"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:02:07.939490 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-a9ce618d-8f2e-4e63-bbe4-a40a2b15e454 req-7e641b31-4ea3-4082-aa11-288827902dfe service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:07.940131 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-a9ce618d-8f2e-4e63-bbe4-a40a2b15e454 req-7e641b31-4ea3-4082-aa11-288827902dfe service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:07.952778 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-a9ce618d-8f2e-4e63-bbe4-a40a2b15e454 req-7e641b31-4ea3-4082-aa11-288827902dfe service nova] Creating event network-vif-deleted:5d30f17c-376a-40af-aea4-819f4cd01ebc for instance 62d1d6a8-9517-49ed-b0eb-d90086cd1783 on hv-cinder-85093 Jul 26 13:02:07.958024 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-a9ce618d-8f2e-4e63-bbe4-a40a2b15e454 req-7e641b31-4ea3-4082-aa11-288827902dfe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033243 Jul 26 13:02:07.959123 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 558/1121] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:02:08.388165 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ffd64376-2e79-4592-962a-32019a0adc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:08.388864 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ffd64376-2e79-4592-962a-32019a0adc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:08.395315 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ffd64376-2e79-4592-962a-32019a0adc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:08.395805 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ffd64376-2e79-4592-962a-32019a0adc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:08.396563 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ffd64376-2e79-4592-962a-32019a0adc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:08.396995 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ffd64376-2e79-4592-962a-32019a0adc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:08.427594 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ffd64376-2e79-4592-962a-32019a0adc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:08.428074 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ffd64376-2e79-4592-962a-32019a0adc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:08.428517 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-ffd64376-2e79-4592-962a-32019a0adc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lazy-loading 'fault' on Instance uuid 62d1d6a8-9517-49ed-b0eb-d90086cd1783 {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 13:02:08.474124 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-ffd64376-2e79-4592-962a-32019a0adc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94efba410653451da2e9977d746633f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2522985c6df452dabe2010e5f6bed35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:02:08.483990 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ffd64376-2e79-4592-962a-32019a0adc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 200 len: 1230 microversion: 2.1 time: 0.099948 Jul 26 13:02:08.484594 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 564/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:02:08 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:02:09.506968 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-af395812-eb41-4dac-b1f1-a63f2f28b435 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:09.507661 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-af395812-eb41-4dac-b1f1-a63f2f28b435 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 62d1d6a8-9517-49ed-b0eb-d90086cd1783] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:09.514051 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-af395812-eb41-4dac-b1f1-a63f2f28b435 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:09.514525 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-af395812-eb41-4dac-b1f1-a63f2f28b435 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:09.515273 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-af395812-eb41-4dac-b1f1-a63f2f28b435 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:09.515731 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-af395812-eb41-4dac-b1f1-a63f2f28b435 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:09.528617 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-af395812-eb41-4dac-b1f1-a63f2f28b435 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] HTTP exception thrown: Instance 62d1d6a8-9517-49ed-b0eb-d90086cd1783 could not be found. Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-af395812-eb41-4dac-b1f1-a63f2f28b435 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Request method failure captured: Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 HTTP/1.1 Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-P6I4oZJTGyBxyXC8K7pa2GPTfIJf6EOGmVLtC59ScPVeMnVd7rnTVHCojwupIXZrf2bh_e2EqqpfganxExWxX_GLRgJYV2f7mYDtQh9nCrZd0yfcEhBeZKdqmQITp2eixdDBPg-Y0vW3RkVC902oxYQPTGR0qCwCaspEZOyZrnaCE Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: a2522985c6df452dabe2010e5f6bed35 Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-TestVolumeBootPattern-763444378 Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 13:02:09.530191 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 13:02:09.531857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2522985c6df452dabe2010e5f6bed35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2522985c6df452dabe2010e5f6bed35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2522985c6df452dabe2010e5f6bed35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2522985c6df452dabe2010e5f6bed35"}]}] Jul 26 13:02:09.531857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-TestVolumeBootPattern-763444378 Jul 26 13:02:09.531857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: a2522985c6df452dabe2010e5f6bed35 Jul 26 13:02:09.531857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-TestVolumeBootPattern-763444378 Jul 26 13:02:09.531857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-TestVolumeBootPattern-763444378-project Jul 26 13:02:09.531857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 13:02:09.531857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 13:02:09.531857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 94efba410653451da2e9977d746633f6 Jul 26 13:02:09.531857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-TestVolumeBootPattern-763444378-project Jul 26 13:02:09.531857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 13:02:09.531857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 62d1d6a8-9517-49ed-b0eb-d90086cd1783 could not be found. Jul 26 13:02:09.531857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '62d1d6a8-9517-49ed-b0eb-d90086cd1783'} Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d1d6a8-9517-49ed-b0eb-d90086cd1783 could not be found. Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:02:09.532831 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d1d6a8-9517-49ed-b0eb-d90086cd1783 could not be found. Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d1d6a8-9517-49ed-b0eb-d90086cd1783 could not be found. Jul 26 13:02:09.534124 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:09.535362 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-af395812-eb41-4dac-b1f1-a63f2f28b435 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Returning 404 to user: Instance 62d1d6a8-9517-49ed-b0eb-d90086cd1783 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:02:09.535362 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-af395812-eb41-4dac-b1f1-a63f2f28b435 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783" status: 404 len: 111 microversion: 2.1 time: 0.029550 Jul 26 13:02:09.535362 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 559/1123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:02:09 2022] GET /compute/v2.1/servers/62d1d6a8-9517-49ed-b0eb-d90086cd1783 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 13:02:09.661853 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-ea7d0945-fded-4576-a6b5-24bbaf1219b9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1339791851"}} {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:02:09.662452 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-ea7d0945-fded-4576-a6b5-24bbaf1219b9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:09.668854 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ea7d0945-fded-4576-a6b5-24bbaf1219b9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:09.669310 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ea7d0945-fded-4576-a6b5-24bbaf1219b9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:09.670710 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ea7d0945-fded-4576-a6b5-24bbaf1219b9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:09.671152 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-ea7d0945-fded-4576-a6b5-24bbaf1219b9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:09.804386 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.network.security_group_api [None req-ea7d0945-fded-4576-a6b5-24bbaf1219b9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Removing security group 45c67f8a-b10b-4e80-b40c-398a5fc3c56e from port 9b53c6b7-b508-47dc-b083-ba526341c773 Jul 26 13:02:10.027504 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-578bf87a-c6ab-4298-8b95-d98e79afcc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:10.028148 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-578bf87a-c6ab-4298-8b95-d98e79afcc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:10.034693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-578bf87a-c6ab-4298-8b95-d98e79afcc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:10.035210 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-578bf87a-c6ab-4298-8b95-d98e79afcc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:10.036078 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-578bf87a-c6ab-4298-8b95-d98e79afcc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:10.036577 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-578bf87a-c6ab-4298-8b95-d98e79afcc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:10.050851 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-578bf87a-c6ab-4298-8b95-d98e79afcc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] HTTP exception thrown: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-578bf87a-c6ab-4298-8b95-d98e79afcc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Request method failure captured: Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: DELETE /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 HTTP/1.1 Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-P6I4oZJTGyBxyXC8K7pa2GPTfIJf6EOGmVLtC59ScPVeMnVd7rnTVHCojwupIXZrf2bh_e2EqqpfganxExWxX_GLRgJYV2f7mYDtQh9nCrZd0yfcEhBeZKdqmQITp2eixdDBPg-Y0vW3RkVC902oxYQPTGR0qCwCaspEZOyZrnaCE Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: a2522985c6df452dabe2010e5f6bed35 Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-TestVolumeBootPattern-763444378 Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 13:02:10.052543 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 13:02:10.054288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2522985c6df452dabe2010e5f6bed35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2522985c6df452dabe2010e5f6bed35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2522985c6df452dabe2010e5f6bed35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2522985c6df452dabe2010e5f6bed35"}]}] Jul 26 13:02:10.054288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-TestVolumeBootPattern-763444378 Jul 26 13:02:10.054288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: a2522985c6df452dabe2010e5f6bed35 Jul 26 13:02:10.054288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-TestVolumeBootPattern-763444378 Jul 26 13:02:10.054288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-TestVolumeBootPattern-763444378-project Jul 26 13:02:10.054288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 13:02:10.054288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 13:02:10.054288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 94efba410653451da2e9977d746633f6 Jul 26 13:02:10.054288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-TestVolumeBootPattern-763444378-project Jul 26 13:02:10.054288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 13:02:10.054288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 13:02:10.054288 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '48d9b3cf-bdc1-4718-83b8-f0136bfa33c6'} Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:02:10.056114 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 13:02:10.058363 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:10.060074 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-578bf87a-c6ab-4298-8b95-d98e79afcc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Returning 404 to user: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:02:10.060074 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-578bf87a-c6ab-4298-8b95-d98e79afcc55 tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "DELETE /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 404 len: 111 microversion: 2.1 time: 0.030235 Jul 26 13:02:10.060074 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 560/1124] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 13:02:10 2022] DELETE /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 13:02:10.062293 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ed25d384-7f52-4141-b6c0-d4a0e5e4ea6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:10.062890 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-ed25d384-7f52-4141-b6c0-d4a0e5e4ea6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] [instance: 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:10.069627 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed25d384-7f52-4141-b6c0-d4a0e5e4ea6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:10.069861 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed25d384-7f52-4141-b6c0-d4a0e5e4ea6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:10.070672 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed25d384-7f52-4141-b6c0-d4a0e5e4ea6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:10.071176 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-ed25d384-7f52-4141-b6c0-d4a0e5e4ea6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:10.089792 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-ed25d384-7f52-4141-b6c0-d4a0e5e4ea6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] HTTP exception thrown: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ed25d384-7f52-4141-b6c0-d4a0e5e4ea6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Request method failure captured: Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 HTTP/1.1 Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-P6I4oZJTGyBxyXC8K7pa2GPTfIJf6EOGmVLtC59ScPVeMnVd7rnTVHCojwupIXZrf2bh_e2EqqpfganxExWxX_GLRgJYV2f7mYDtQh9nCrZd0yfcEhBeZKdqmQITp2eixdDBPg-Y0vW3RkVC902oxYQPTGR0qCwCaspEZOyZrnaCE Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: a2522985c6df452dabe2010e5f6bed35 Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-TestVolumeBootPattern-763444378 Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 13:02:10.091286 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 13:02:10.093616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2522985c6df452dabe2010e5f6bed35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2522985c6df452dabe2010e5f6bed35", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2522985c6df452dabe2010e5f6bed35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2522985c6df452dabe2010e5f6bed35"}]}] Jul 26 13:02:10.093616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-TestVolumeBootPattern-763444378 Jul 26 13:02:10.093616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: a2522985c6df452dabe2010e5f6bed35 Jul 26 13:02:10.093616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-TestVolumeBootPattern-763444378 Jul 26 13:02:10.093616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-TestVolumeBootPattern-763444378-project Jul 26 13:02:10.093616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 13:02:10.093616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 13:02:10.093616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 94efba410653451da2e9977d746633f6 Jul 26 13:02:10.093616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-TestVolumeBootPattern-763444378-project Jul 26 13:02:10.093616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 13:02:10.093616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 13:02:10.093616 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '48d9b3cf-bdc1-4718-83b8-f0136bfa33c6'} Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:02:10.094640 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. Jul 26 13:02:10.096913 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:10.098274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-ed25d384-7f52-4141-b6c0-d4a0e5e4ea6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Returning 404 to user: Instance 48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:02:10.098274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-ed25d384-7f52-4141-b6c0-d4a0e5e4ea6a tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6" status: 404 len: 111 microversion: 2.1 time: 0.034913 Jul 26 13:02:10.098274 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 561/1125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:02:10 2022] GET /compute/v2.1/servers/48d9b3cf-bdc1-4718-83b8-f0136bfa33c6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 13:02:10.210526 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-ea7d0945-fded-4576-a6b5-24bbaf1219b9 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "POST /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/action" status: 202 len: 0 microversion: 2.1 time: 0.552850 Jul 26 13:02:10.211856 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 565/1126] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Jul 26 13:02:09 2022] POST /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 13:02:10.233993 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-00fa7734-5a08-471a-8b4f-0d9247f0a179 req-ff5c6925-b537-4e25-9ead-d4ea96c4a0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44eb7c3c-129d-48bc-90eb-ce1c60c10d2e", "tag": "9b53c6b7-b508-47dc-b083-ba526341c773"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:02:10.253299 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-00fa7734-5a08-471a-8b4f-0d9247f0a179 req-ff5c6925-b537-4e25-9ead-d4ea96c4a0a0 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:10.254002 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-00fa7734-5a08-471a-8b4f-0d9247f0a179 req-ff5c6925-b537-4e25-9ead-d4ea96c4a0a0 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:10.267732 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-00fa7734-5a08-471a-8b4f-0d9247f0a179 req-ff5c6925-b537-4e25-9ead-d4ea96c4a0a0 service nova] Creating event network-changed:9b53c6b7-b508-47dc-b083-ba526341c773 for instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e on hv-cinder-85093 Jul 26 13:02:10.273529 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-00fa7734-5a08-471a-8b4f-0d9247f0a179 req-ff5c6925-b537-4e25-9ead-d4ea96c4a0a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047700 Jul 26 13:02:10.275850 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 562/1127] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:02:11.450308 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4a148cf3-8a33-442c-b842-29b4a48bf32f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] Calling method '.version_select at 0x7f65f9b32c10>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:11.475207 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4a148cf3-8a33-442c-b842-29b4a48bf32f tempest-TestVolumeBootPattern-763444378 tempest-TestVolumeBootPattern-763444378-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1602648222" status: 202 len: 0 microversion: 2.1 time: 0.030257 Jul 26 13:02:11.476059 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 566/1128] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Jul 26 13:02:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1602648222 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 13:02:12.004145 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-2f4ab6a0-588e-42b3-9c25-103c0944f497 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:12.004858 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-2f4ab6a0-588e-42b3-9c25-103c0944f497 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:12.012453 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2f4ab6a0-588e-42b3-9c25-103c0944f497 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:12.012922 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2f4ab6a0-588e-42b3-9c25-103c0944f497 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:12.014563 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2f4ab6a0-588e-42b3-9c25-103c0944f497 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:12.015011 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-2f4ab6a0-588e-42b3-9c25-103c0944f497 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:12.115795 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.objects.instance [None req-2f4ab6a0-588e-42b3-9c25-103c0944f497 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lazy-loading 'services' on Instance uuid 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e {{(pid=129308) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 13:02:12.203986 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-2f4ab6a0-588e-42b3-9c25-103c0944f497 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "DELETE /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/os-volume_attachments/13056486-3545-4140-a4d0-17ff9f0f2c23" status: 202 len: 0 microversion: 2.1 time: 0.207730 Jul 26 13:02:12.205551 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 563/1129] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Jul 26 13:02:11 2022] DELETE /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/os-volume_attachments/13056486-3545-4140-a4d0-17ff9f0f2c23 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 13:02:12.213783 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-0f81cd84-62cb-462f-a8e6-4679c9ecc98e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:12.216385 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-0f81cd84-62cb-462f-a8e6-4679c9ecc98e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:12.223874 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0f81cd84-62cb-462f-a8e6-4679c9ecc98e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:12.224467 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0f81cd84-62cb-462f-a8e6-4679c9ecc98e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:12.225506 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0f81cd84-62cb-462f-a8e6-4679c9ecc98e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:12.226168 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-0f81cd84-62cb-462f-a8e6-4679c9ecc98e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:12.274970 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-0f81cd84-62cb-462f-a8e6-4679c9ecc98e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065071 Jul 26 13:02:12.276038 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 567/1130] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 13:02:12 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:02:12.294400 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-d67efbf5-a521-4825-b0c0-515faa34c0e9 req-2505cd2f-a395-4f36-bc15-10365f12b339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44eb7c3c-129d-48bc-90eb-ce1c60c10d2e", "tag": "9b53c6b7-b508-47dc-b083-ba526341c773"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:02:12.305249 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-d67efbf5-a521-4825-b0c0-515faa34c0e9 req-2505cd2f-a395-4f36-bc15-10365f12b339 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:12.305692 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-d67efbf5-a521-4825-b0c0-515faa34c0e9 req-2505cd2f-a395-4f36-bc15-10365f12b339 service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:12.319407 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-d67efbf5-a521-4825-b0c0-515faa34c0e9 req-2505cd2f-a395-4f36-bc15-10365f12b339 service nova] Creating event network-changed:9b53c6b7-b508-47dc-b083-ba526341c773 for instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e on hv-cinder-85093 Jul 26 13:02:12.327841 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-d67efbf5-a521-4825-b0c0-515faa34c0e9 req-2505cd2f-a395-4f36-bc15-10365f12b339 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038963 Jul 26 13:02:12.328680 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 564/1131] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:02:13.287747 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-fc6c9e8c-cad2-492b-b8f5-e7e4b95e7c6f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:13.290066 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-fc6c9e8c-cad2-492b-b8f5-e7e4b95e7c6f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:13.297269 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fc6c9e8c-cad2-492b-b8f5-e7e4b95e7c6f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:13.298064 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fc6c9e8c-cad2-492b-b8f5-e7e4b95e7c6f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:13.299279 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fc6c9e8c-cad2-492b-b8f5-e7e4b95e7c6f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:13.299960 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-fc6c9e8c-cad2-492b-b8f5-e7e4b95e7c6f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:13.332108 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-fc6c9e8c-cad2-492b-b8f5-e7e4b95e7c6f tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048243 Jul 26 13:02:13.332890 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 568/1132] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Jul 26 13:02:13 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 13:02:13.345282 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3eaae0e8-f130-448e-a9aa-f8d47ef86a59 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:13.345895 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-3eaae0e8-f130-448e-a9aa-f8d47ef86a59 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:13.352734 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3eaae0e8-f130-448e-a9aa-f8d47ef86a59 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:13.353192 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3eaae0e8-f130-448e-a9aa-f8d47ef86a59 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:13.353967 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3eaae0e8-f130-448e-a9aa-f8d47ef86a59 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:13.355193 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-3eaae0e8-f130-448e-a9aa-f8d47ef86a59 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:13.437221 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-3eaae0e8-f130-448e-a9aa-f8d47ef86a59 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] HTTP exception thrown: Instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e is not attached to volume 13056486-3545-4140-a4d0-17ff9f0f2c23 Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3eaae0e8-f130-448e-a9aa-f8d47ef86a59 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Request method failure captured: Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: DELETE /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/os-volume_attachments/13056486-3545-4140-a4d0-17ff9f0f2c23 HTTP/1.1 Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-VY8CHt1KY6_rYuZgn_Jjs4KXUwUIZvbhwj7bjp_aISywqYC4as-QwipKQNJxs4sccoAcrT9B5BihC25zt6P71Eb2FhcfF2yg3NXYMZubBgUFjpwi-3WjeFYAzc65QVPCpPZpA30ha_c2EE0qCPs_6lsfGsoCyjBcdD9VndI1XxYdw Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: 2ef477e2598b4c7bbd40c06ccd26112b Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-TestMinimumBasicScenario-176933658 Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 13:02:13.439924 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 13:02:13.441473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ef477e2598b4c7bbd40c06ccd26112b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ef477e2598b4c7bbd40c06ccd26112b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ef477e2598b4c7bbd40c06ccd26112b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ef477e2598b4c7bbd40c06ccd26112b"}]}] Jul 26 13:02:13.441473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-TestMinimumBasicScenario-176933658 Jul 26 13:02:13.441473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: 2ef477e2598b4c7bbd40c06ccd26112b Jul 26 13:02:13.441473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-TestMinimumBasicScenario-176933658 Jul 26 13:02:13.441473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-TestMinimumBasicScenario-176933658-project Jul 26 13:02:13.441473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 13:02:13.441473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 13:02:13.441473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 68818cd15fad466cb7cb5584212fe2f9 Jul 26 13:02:13.441473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-TestMinimumBasicScenario-176933658-project Jul 26 13:02:13.441473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 13:02:13.441473 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e is not attached to volume 13056486-3545-4140-a4d0-17ff9f0f2c23 Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'server_id': '44eb7c3c-129d-48bc-90eb-ce1c60c10d2e', 'id': '13056486-3545-4140-a4d0-17ff9f0f2c23'} Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 13056486-3545-4140-a4d0-17ff9f0f2c23. Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:02:13.442268 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e is not attached to volume 13056486-3545-4140-a4d0-17ff9f0f2c23 Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e is not attached to volume 13056486-3545-4140-a4d0-17ff9f0f2c23 Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:13.444374 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-3eaae0e8-f130-448e-a9aa-f8d47ef86a59 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Returning 404 to user: Instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e is not attached to volume 13056486-3545-4140-a4d0-17ff9f0f2c23 {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:02:13.445648 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-3eaae0e8-f130-448e-a9aa-f8d47ef86a59 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "DELETE /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/os-volume_attachments/13056486-3545-4140-a4d0-17ff9f0f2c23" status: 404 len: 154 microversion: 2.1 time: 0.101210 Jul 26 13:02:13.445648 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 565/1133] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Jul 26 13:02:13 2022] DELETE /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e/os-volume_attachments/13056486-3545-4140-a4d0-17ff9f0f2c23 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 13:02:14.623918 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-1c741304-ea62-4cb5-9836-90d2c960a7fd tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:14.628358 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1c741304-ea62-4cb5-9836-90d2c960a7fd tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:14.635780 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1c741304-ea62-4cb5-9836-90d2c960a7fd tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:14.636886 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1c741304-ea62-4cb5-9836-90d2c960a7fd tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:14.638131 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1c741304-ea62-4cb5-9836-90d2c960a7fd tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:14.639455 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-1c741304-ea62-4cb5-9836-90d2c960a7fd tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:14.673422 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-1c741304-ea62-4cb5-9836-90d2c960a7fd tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Going to try to terminate instance {{(pid=129307) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 13:02:14.771404 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-1c741304-ea62-4cb5-9836-90d2c960a7fd tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "DELETE /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 204 len: 0 microversion: 2.1 time: 0.151619 Jul 26 13:02:14.772977 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 569/1134] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Jul 26 13:02:14 2022] DELETE /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 13:02:14.782632 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-9f3b8b34-f5d5-4c57-92ee-01d6c7a2d93e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:14.784087 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-9f3b8b34-f5d5-4c57-92ee-01d6c7a2d93e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:14.790762 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9f3b8b34-f5d5-4c57-92ee-01d6c7a2d93e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:14.791223 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9f3b8b34-f5d5-4c57-92ee-01d6c7a2d93e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:14.792040 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9f3b8b34-f5d5-4c57-92ee-01d6c7a2d93e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:14.792482 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-9f3b8b34-f5d5-4c57-92ee-01d6c7a2d93e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:14.942413 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.policy [None req-9f3b8b34-f5d5-4c57-92ee-01d6c7a2d93e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129308) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:02:14.949785 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-9f3b8b34-f5d5-4c57-92ee-01d6c7a2d93e tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1555 microversion: 2.1 time: 0.171819 Jul 26 13:02:14.949999 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 566/1135] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:02:14 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:02:15.971383 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-4a7a9e57-c71a-44e6-8b09-cda220253377 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:15.972135 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-4a7a9e57-c71a-44e6-8b09-cda220253377 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:15.978507 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4a7a9e57-c71a-44e6-8b09-cda220253377 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:15.978966 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4a7a9e57-c71a-44e6-8b09-cda220253377 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:15.979772 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4a7a9e57-c71a-44e6-8b09-cda220253377 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:15.980215 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-4a7a9e57-c71a-44e6-8b09-cda220253377 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:16.201666 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-4a7a9e57-c71a-44e6-8b09-cda220253377 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:02:16.210640 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-4a7a9e57-c71a-44e6-8b09-cda220253377 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1555 microversion: 2.1 time: 0.243886 Jul 26 13:02:16.211414 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 570/1136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:02:15 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:02:17.080234 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [req-4e2a9511-440e-47ac-a099-69337dd9cc0d req-c5f66c5d-e111-4f79-84a3-522bb893e12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44eb7c3c-129d-48bc-90eb-ce1c60c10d2e", "name": "network-vif-deleted", "tag": "9b53c6b7-b508-47dc-b083-ba526341c773"}]} {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 13:02:17.092212 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-4e2a9511-440e-47ac-a099-69337dd9cc0d req-c5f66c5d-e111-4f79-84a3-522bb893e12e service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:17.092982 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [req-4e2a9511-440e-47ac-a099-69337dd9cc0d req-c5f66c5d-e111-4f79-84a3-522bb893e12e service nova] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:17.104906 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.compute.server_external_events [req-4e2a9511-440e-47ac-a099-69337dd9cc0d req-c5f66c5d-e111-4f79-84a3-522bb893e12e service nova] Creating event network-vif-deleted:9b53c6b7-b508-47dc-b083-ba526341c773 for instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e on hv-cinder-85093 Jul 26 13:02:17.111351 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [req-4e2a9511-440e-47ac-a099-69337dd9cc0d req-c5f66c5d-e111-4f79-84a3-522bb893e12e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037312 Jul 26 13:02:17.112617 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 567/1137] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Jul 26 13:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 13:02:17.233260 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-10d43d17-621d-41fc-9baa-9a28dc979be8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:17.233882 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.compute.api [None req-10d43d17-621d-41fc-9baa-9a28dc979be8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129307) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:17.240628 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10d43d17-621d-41fc-9baa-9a28dc979be8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:17.241104 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10d43d17-621d-41fc-9baa-9a28dc979be8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:17.241867 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10d43d17-621d-41fc-9baa-9a28dc979be8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:17.242672 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10d43d17-621d-41fc-9baa-9a28dc979be8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:17.273901 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10d43d17-621d-41fc-9baa-9a28dc979be8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:17.274349 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG oslo_concurrency.lockutils [None req-10d43d17-621d-41fc-9baa-9a28dc979be8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:17.275000 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.objects.instance [None req-10d43d17-621d-41fc-9baa-9a28dc979be8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lazy-loading 'fault' on Instance uuid 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e {{(pid=129307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 13:02:17.317799 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.policy [None req-10d43d17-621d-41fc-9baa-9a28dc979be8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68818cd15fad466cb7cb5584212fe2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ef477e2598b4c7bbd40c06ccd26112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129307) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 13:02:17.326748 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-10d43d17-621d-41fc-9baa-9a28dc979be8 tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 200 len: 1349 microversion: 2.1 time: 0.097898 Jul 26 13:02:17.327331 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 571/1138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:02:17 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 13:02:18.350498 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-221b6ce3-5949-4ee8-92a3-ddfc1302c9ed tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '>' {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:18.351334 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.compute.api [None req-221b6ce3-5949-4ee8-92a3-ddfc1302c9ed tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] [instance: 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e] Fetching instance by UUID {{(pid=129308) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 13:02:18.364152 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-221b6ce3-5949-4ee8-92a3-ddfc1302c9ed tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:18.364900 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-221b6ce3-5949-4ee8-92a3-ddfc1302c9ed tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:18.365921 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-221b6ce3-5949-4ee8-92a3-ddfc1302c9ed tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 13:02:18.366548 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG oslo_concurrency.lockutils [None req-221b6ce3-5949-4ee8-92a3-ddfc1302c9ed tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Lock "75e7599b-cac8-41c9-b1ee-f59349f865d3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129308) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 13:02:18.388515 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.wsgi [None req-221b6ce3-5949-4ee8-92a3-ddfc1302c9ed tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] HTTP exception thrown: Instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e could not be found. Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-221b6ce3-5949-4ee8-92a3-ddfc1302c9ed tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Request method failure captured: Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: request: GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e HTTP/1.1 Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept: application/json Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Accept-Encoding: identity Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Connection: close Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Length: 0 Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Content-Type: application/json Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Host: 10.222.0.20 Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Openstack-System-Scope: None Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: User-Agent: python-urllib3/1.26.10 Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Auth-Token: gAAAAABi3-VY8CHt1KY6_rYuZgn_Jjs4KXUwUIZvbhwj7bjp_aISywqYC4as-QwipKQNJxs4sccoAcrT9B5BihC25zt6P71Eb2FhcfF2yg3NXYMZubBgUFjpwi-3WjeFYAzc65QVPCpPZpA30ha_c2EE0qCPs_6lsfGsoCyjBcdD9VndI1XxYdw Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Id: None Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Domain-Name: None Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Identity-Status: Confirmed Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Is-Admin-Project: True Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Id: default Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Domain-Name: Default Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Id: 2ef477e2598b4c7bbd40c06ccd26112b Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Project-Name: tempest-TestMinimumBasicScenario-176933658 Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Role: member,reader Jul 26 13:02:18.390628 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Roles: member,reader Jul 26 13:02:18.392135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ef477e2598b4c7bbd40c06ccd26112b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ef477e2598b4c7bbd40c06ccd26112b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ef477e2598b4c7bbd40c06ccd26112b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ef477e2598b4c7bbd40c06ccd26112b"}]}] Jul 26 13:02:18.392135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant: tempest-TestMinimumBasicScenario-176933658 Jul 26 13:02:18.392135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Id: 2ef477e2598b4c7bbd40c06ccd26112b Jul 26 13:02:18.392135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-Tenant-Name: tempest-TestMinimumBasicScenario-176933658 Jul 26 13:02:18.392135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User: tempest-TestMinimumBasicScenario-176933658-project Jul 26 13:02:18.392135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Id: default Jul 26 13:02:18.392135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Domain-Name: Default Jul 26 13:02:18.392135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Id: 68818cd15fad466cb7cb5584212fe2f9 Jul 26 13:02:18.392135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: X-User-Name: tempest-TestMinimumBasicScenario-176933658-project Jul 26 13:02:18.392135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: method: > Jul 26 13:02:18.392135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: exception: Instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e could not be found. Jul 26 13:02:18.392135 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: action_args: {'id': '44eb7c3c-129d-48bc-90eb-ce1c60c10d2e'} Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: {{(pid=129308) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e could not be found. Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 13:02:18.393089 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e could not be found. Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e could not be found. Jul 26 13:02:18.394602 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: ERROR nova.api.openstack.wsgi Jul 26 13:02:18.397693 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: DEBUG nova.api.openstack.wsgi [None req-221b6ce3-5949-4ee8-92a3-ddfc1302c9ed tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Returning 404 to user: Instance 44eb7c3c-129d-48bc-90eb-ce1c60c10d2e could not be found. {{(pid=129308) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 13:02:18.399389 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO nova.api.openstack.requestlog [None req-221b6ce3-5949-4ee8-92a3-ddfc1302c9ed tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e" status: 404 len: 111 microversion: 2.1 time: 0.054650 Jul 26 13:02:18.403512 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: [pid: 129308|app: 0|req: 568/1139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Jul 26 13:02:18 2022] GET /compute/v2.1/servers/44eb7c3c-129d-48bc-90eb-ce1c60c10d2e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 13:02:18.411335 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: DEBUG nova.api.openstack.wsgi [None req-d4354a37-d727-4203-a435-d1360b1b4eab tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] Calling method '.version_select at 0x7f65f9b4b550>' {{(pid=129307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 13:02:18.438052 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO nova.api.openstack.requestlog [None req-d4354a37-d727-4203-a435-d1360b1b4eab tempest-TestMinimumBasicScenario-176933658 tempest-TestMinimumBasicScenario-176933658-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1655821461" status: 202 len: 0 microversion: 2.1 time: 0.032462 Jul 26 13:02:18.442439 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: [pid: 129307|app: 0|req: 572/1140] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Jul 26 13:02:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1655821461 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 13:04:48.176870 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 13:04:48.177527 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Tue Jul 26 13:04:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 13:04:48.333161 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 13:04:48.333763 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Tue Jul 26 13:04:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 13:04:52.105857 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 13:04:52.106472 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Tue Jul 26 13:04:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 13:05:04.780264 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 13:05:04.780847 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Tue Jul 26 13:05:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 13:05:06.617406 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 13:05:06.617973 dv-cinder-850939-2-iscsi devstack@n-api.service[129308]: Tue Jul 26 13:05:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 13:06:28.069446 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 13:06:28.070077 dv-cinder-850939-2-iscsi devstack@n-api.service[129307]: Tue Jul 26 13:06:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!